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(54) A three-dimensional representation method and an apparatus thereof 



(57) A three-dimensional representation method for 
generating a three-dimensional image by displaying 
two-dimensional images on a plurality of image planes 
(101, 102) located at different depth positions wherein 
two-dimensional images (105, 106) are generated in 
which an object to be presented is projected, along the 



line of sight of an observer, onto the plurality of image 
planes located at different depth positions as seen from 
the observer, the brightness levels of the generated two- 
dimensional images are changed individually for each 
image plane and the generated two-dimensional imag- 
es are displayed on the plurality of image planes. 
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Description 

[0001] The present invention relates to a three-dimen- 
sional representation method and an apparatus capable 
of electronically reproducing a moving picture or video s 
with a reduced amount of information on a three-dimen- 
sional image. 

[0002] A liquid crystal shutter eyeglasses system 
shown in Fig. 1 is well known as a conventional system 
which is electrically rewritable, has a small amount of io 
information and can display a three-dimensional video. 
[0003] The working principle of the liquid crystal shut- 
ter eyeglasses system will be explained below. 
[0004] In this liquid crystal shutter eyeglasses system, 
a three-dimensional object a1 is shot by cameras (a2, is 
a3) from different directions to generate images (paral- 
lactic images) representing the three-dimensional ob- 
ject al as viewed from different directions. 
[0005] The images taken by the cameras (a2, a3) are 
combined by a video signal converter a4 into a single 20 
video signal and fed into a two-dimensional display (for 
example, CRT display) a5. 

[0006] An observer a7 views an image on the two- 
dimensional display ct5 by wearing liquid crystal shutter 
eyeglasses <x6. 2 s 
[0007] Here, when the two-dimensional display a5 is 
displaying an image from the camera <x3, the liquid crys- 
tal shutter eyeglasses oc6 are made opaque on the left 
side and transparent on the right side. When the two- 
dimensional display a5 is displaying an image from the 30 
camera a2, the liquid crystal shutter eyeglasses a6 are 
made transparent on the left side and opaque on the 
right side. 

[0008] By switching the above operations at high 
speed, the viewer feels he is watching parallactic imag- 3S 
es with both eyes because of the after image effect and 
therefore can see the object three-dimensionally be- 
cause of binocular parallax. 

[0009] Further, a volumetric system as shown in Figs. 
2A and 2B has been proposed as one of the conven- 40 
tional systems that are electrically rewritable, have a 
small amount of information and can display a three-di- 
mensional video. 

[001 0] The working principle of this volumetric system 
is explained in the following. 45 
[0011] In the volumetric type, as shown in Fig. 2B, a 
three-dimensional object (51 is sampled in the direction 
of depth as seen from the viewer to generate a set of 
two-dimensional images p2, which is reproduced in a 
depth direction on a time division basis on a volumetric so 
three-dimensional display 03 to display a reproduced 
three-dimensional image p4. 

[0012] The liquid crystal shutter eyeglasses system 
shown in Fig. 1 , however, has a drawback that because 
of the required use of the liquid crystal shutter eyeglass- ss 
es o6, the system, when used for teleconferencing, 
looks very unnatural. 

[001 3] Further, there are large inconsistencies among 



binocular parallax, convergence and focusing, which 
are physiological factors of stereoscopy. 
[0014] That is, in the liquid crystal shutter eyeglasses 
system shown in Fig. 1, although the requirements of 
binocular parallax and convergence are almost met, this 
system will cause eyestrain because the focal plane is 
on the display surface. 

[0015] In the volumetric type shown in Figs. 2 A and 
2B, the depth positions of the reproduced three-dimen- 
sional object P1 are close to the surfaces on which im- 
ages are actually displayed, and are also disposed be- 
tween these surfaces, so that unlike the liquid crystal 
shutter eyeglasses system, this volumetric system can 
suppress contradictions among binocular parallax, con- 
vergence and focusing. 

[001 6] With the volumetric system , however, because 
the depth positions of the reproduced images are dis- 
crete, it is difficult to reproduce a three-dimensional ob- 
ject located at an intermediate position between the dis- 
creel display positions, or a three-dimensional object 
that varies greatly in the depth direction. 
[0017] It is an object of the present invention to pro- 
vide a three-dimensional representation method and 
apparatus capable of displaying a video without requir- 
ing a viewer to wear glasses. 

[0018] Another object of the invention is to provide a 
three-dimensional representation method and appara- 
tus which can suppress contradictions among physio- 
logical factors for stereoscopy. 

[0019] Another object of the invention is to provide a 
three-dimensional representation method and appara- 
tus which can be electrically erased and programmed. 
[0020] These and other objects and novel features of 
the invention will become apparent from the following 
descriptions in this specification and accompanying 
drawings. 

[0021] Representative aspects of the present inven- 
tion may be briefly summarized as follows. 
[0022] This invention is characterized by a three-di- 
mensional representation method for generating a 
three-dimensional image by displaying two-dimensional 
images on a plurality of image planes located at different 
depth positions, the method comprising the steps of: 
generating two-dimensional images by projecting an ob- 
ject to be presented, along the line of sight of an observ- 
er, onto a plurality of image planes located at different 
depth positions as seen from the observer; and chang- 
ing brightness levels of the generated two-dimensional 
images individually for each image plane and displaying 
the generated two-dimensional images on the plurality 
of image planes. 

[0023] According to the invention, when the object to 
be presented is displayed at a depth position close to 
the observer, the brightness levels of the two-dimen- 
sional images displayed on those image planes of the 
plurality of image planes which are close to the observer 
may be raised and the brightness levels of the two-di- 
mensional images displayed on the image planes re- 
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mote from the observer may be lowered. When the ob- 
ject to be presented is displayed at a depth position re- 
mote from the observer, the brightness levels of the two- 
dimensional images displayed on those image planes 
of the plurality of image planes which are close to the 
observer may be lowered and the brightness levels of 
the two-dimensional images displayed on the image 
planes remote from the observer may be raised. 
[0024] The two-dimensional images are displayed on 
the plurality of image planes in such a way that the two- 
dimensional images overlap each other when the two- 
dimensional images are viewed from one point on a line 
which passes through the right and left eyes of an ob- 
server, and that an overall brightness level as seen by 
the observer is equal to the brightness level of the orig- 
inal object to be presented. 

[0025] According to the invention, the two-dimension- 
al images are arranged to overlap by viewing from one 
point on the line which passes through the right and left 
of the observer and the two-dimensional images are en- 
larged or reduced in the horizontal direction respective- 
ly. 

[0026] According to the invention, the two-dimension- 
al images may be switched successively to generate a 
three-dimensional moving image. 
[0027] According to the invention, when the two-di- 
mensional images include a plurality of images of an ob- 
ject moving in a direction ol depth and the object is mov- 
ing toward the observer, the brightness levels of the ob- 
ject images displayed on the plurality of image planes 
may be progressively raised toward an image plane 
close to the observer and progressively lowered toward 
an image plane remote from the observer in synchro- 
nism with the successive switching of the two-dimen- 
sional images, and when the two-dimensional images 
include a plurality of images of an object moving in a 
direction of depth and the object is moving away from 
the observer, the brightness levels of the object images 
displayed on the plurality of image planes may be pro- 
gressively lowered toward an image plane close to the 
observer and progressively raised toward an image 
plane remote from the observer in synchronism with the 
successive switching of the two-dimensional images. 
[0028] According to the invention, a three-dimension- 
al display may comprise: a first means for generating 
two-dimensional images by projecting an object to be 
presented, along the line of sight of an observer, onto a 
plurality of image planes located at different depth po- 
sitions as seen from the observer; a second means for 
displaying the two-dimensional images generated by 
the first means on the plurality of image planes located 
at different depth positions as seen from the observer; 
and a third means for changing brightness levels of the 
two-dimensional images displayed on the plurality of im- 
age planes individually for each image plane. 
[0029] According to the invention, the second means 
may comprise: a plurality of two-dimensional displays; 
and partial reflecting mirrors combined with the plurality 



of two-dimensional displays except for one two-dimen- 
sional display located at the remotest depth position 
from the observer, the partial reflecting mirrors being 
adapted to locate images of the two-dimensional dis- 
5 plays on the line of sight of the observer. 

[0030] According to the invention, the second means 
may comprise: a plurality of two-dimensional displays; 
and combinations of partial reflecting mirrors and lens- 
es, the partial reflecting mirror and lens combinations 

io being combined with the plurality of two-dimensional 
displays except for one two-dimensional display located 
at the remotest depth position from the observer, the 
partial reflecting mirror and lens combinations being 
adapted to locate images of the two-dimensional dis- 

15 plays on the line of sight of the observer. 

[0031] According to the invention, the second means 
may comprise: a plurality of two-dimensional displays; 
a total reflecting mirror or partial reflecting mirror com- 
bined with one of the plurality of two-dimensional dis- 

20 plays which is located at the remotest depth position 
from the observer, the total reflecting mirror or partial 
reflecting mirror being adapted to locate an image of the 
one two-dimensional display on the line of sight of the 
observer; and partial reflecting mirrors combined with 

2S the two-dimensional displays except for the one two-di- 
mensional display located at the remotest depth position 
from the observer, the partial reflecting mirrors being 
adapted to locate images of the two-dimensional dis- 
plays t on the line of sight of the observers. 

30 [0032] According to the invention, the second means 
may comprise: a plurality of two-dimensional displays; 
a combination of a total reflecting mirror and a lens or a 
combination of a partial reflecting mirror and a lens, the 
combination being combined with one of the plurality of 

35 two-dimensional displays which is located at the remot- 
est depth position from the observer, the combination 
being adapted to locate an image of the one two-dimen- 
sional display on the line of sight of the observer; and 
combinations of partial reflecting mirrors and lenses, the 

40 combinations being combined with the two-dimensional 
displays except for one two-dimensional display located 
at the remotest depth position from the observer, the 
combinations being adapted to locate images of the two- 
dimensional displays on the line of sight of the observer. 

45 [0033] According to the invention, the second means 
may comprise: a plurality of scatter plates capable of 
controlling a switching between a transmitting state and 
a scattering state or a plurality of reflection plates capa- 
ble of controlling the switching between a reflecting state 

50 and a transmitting state, the scatter plates or reflection 
plates being located at different depth positions as 
viewed from the observer, a plurality of projection type 
two-dimensional displays for projecting two-dimension- 
al images onto the plurality of scatter plates or the plu- 

55 rality of reflection plates; and a plurality of shutters dis- 
posed between the plurality of scatter plates or reflection 
plates and the plurality of projection type two-dimen- 
sional displays, the plurality of shutters being adapted 
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to switch between a transmitting state and a cutoff state 
in synchronism with the switching between the transmit- 
ting state and the scattering state of the plurality of scat- 
ter plates or between the reflecting state and the trans- 
mitting state of the plurality of reflection plates. s 
[0034] According to the invention, a lens optical sys- 
tem may be disposed between the observer and the plu- 
rality of image planes located at different depth positions 
as seen from the observer. 

[0035] According to the invention, the second means io 
may comprise a two-dimensional display, an optical sys- 
tem, and a varifocal mirror. 

[0036] According to the invention, the second means 
may comprise: a vibration screen which vibrates in the 
direction of depth; an optical system including a lens; a is 
scanning means lor raster-scanning a laser beam; and 
a laser beam source. 

[0037] According to the invention, the second means 
may comprise: an LED display having an LED array; a 
parallel advancing/rotating device for parallelly advanc- 20 
ing/rotating the LED display; and a video feeding device 
for feeding a video signal to the LED display. 
[0038] According to the invention, the second means 
may comprise: a film having a two-dimensional image 
recorded therein or two-dimensional display; an image 25 
transforming optical system having a prism or mirror; 
and a projection drum. 

[0039] According to the invention, the second means 
may successively switch the two-dimensional images 
generated by the first means to generate a moving 30 
three-dimensional image. 

[0040] According to the invention, when the two-di- 
mensional images generated by the first means include 
a plurality of images of an object moving in a direction 
of depth and the object is moving toward the observer, 35 
the third means may progressively raise the brightness 
levels of the object images displayed on the plurality of 
image planes toward an image plane close to the ob- 
server and progressively lower the brightness levels of 
the object images toward an image plane remote from 40 
the observer in synchronism with the successive switch- 
ing of the two-dimensional images by the second 
means, and when the object is moving away from the 
observer, the third means may progressively lower the 
brightness levels of the object images displayed on the <s 
plurality of image planes toward an image plane close 
to the observer and progressively raise the brightness 
levels of the object images toward an image plane re- 
mote from the observer in synchronism with the succes- 
sive switching of the two-dimensional images by the so 
second means. 

[0041] The above and other objects, effects, features 
and advantages of the present invention will become 
more apparent from the following description of embod- 
iments thereof taken in conjunction with the accompa- 55 
nying drawings. 

Fig. 1 is a schematic configuration of a conventional 



three-dimensional display; 
Figs. 2A and 2B are schematic configurations of an- 
other conventional three-dimensional display; 
Fig. 3 is a schematic diagram showing the principle 
of a three-dimensional display according to a first 
embodiment of the present invention; 
Fig. 4 is a schematic diagram showing the principle 
of a three-dimensional display according to the first 
embodiment; 

Fig. 5 is a schematic diagram showing the principle 
of a three-dimensional display according to the first 
embodiment; 

Fig. 6 is a schematic diagram showing the principle 
of a three-dimensional display according to the first 
embodiment; 

Fig. 7 is a schematic diagram showing the principle 
of a three-dimensional display according to the first 
embodiment; 

Fig. 8 is a schematic diagram showing the principle 
of a three-dimensional display according to the first 
embodiment; 

Figs. 9A and 9B are schematic diagrams showing 
the principle of a three-dimensional display accord- 
ing to the first embodiment; 
Figs. 1 0A and 1 0B are schematic diagrams showing 
the principle of a three-dimensional display accord- 
ing to the first embodiment; 
Fig. 11 is a schematic diagram showing the principle 
of a three-dimensional display according to a sec- 
ond embodiment; 

Fig. 12 is a schematic diagram showing the princi- 
ple of a three-dimensional display according to the 
second embodiment; 

Fig. 1 3 is a schematic diagram showing the princi- 
ple of a three-dimensional display according to the 
second embodiment; 

Fig. 14 is a schematic diagram showing the princi- 
ple of a three-dimensional display according to the 
second embodiment; 

Fig. 15 is a schematic diagram showing the princi- 
ple of a three-dimensional display according to the 
second embodiment; 

Fig. 16 is a schematic diagram showing the princi- 
ple of a three-dimensional display according to the 
second embodiment; 

Figs. 1 7 A and l7Bare schematic diagrams showing 
the outline configuration of a three<fimensional dis- 
play according to a third embodiment of the inven- 
tion; 

Figs. 1 8 Aand 18B are schematic diagrams showing 
examples that allow flexible changes in the position 
of an image plane by incorporating a lens or the like 
in an optical system of the third embodiment; 
Figs. 19 is a schematic diagram showing an exam- 
ple in which there is an increased number of two- 
dimensional displays, according to the third embod- 
iment; 

Fig. 20 is a schematic diagram showing an example 
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which uses a plurality of projector type two-dimen- 
sional displays of the third embodiment and scatter 
plates to form an optical system that projects imag- 
es from the projectors onto the scatter plates; 
Fig. 2 1 is a schematic diagram showing another ex- s 
ample which adds optical devices to the third em- 
bodiment; 

Fig. 22 is a schematic diagram showing the outline 
configuration of a varifocal mirror type volumetric 
three-dimensional display according to a fourth em- 10 
bodiment of the invention; 
Fig. 23 is a schematic diagram showing the outline 
configuration of a vibration screen type volumetric 
three-dimensional display according to the fourth 
embodiment; is 
Fig. 24 is a schematic diagram showing the outline 
configuration of a rotary LED type three-dimension- 
al display according to a fifth embodiment of the in- 
vention; 

Fig. 25 is a schematic diagram showing the outline 20 
configuration of a synthalyzer type three-dimen- 
sional display according to a sixth embodiment of 
the invention; 

Figs. 26A and 26B are conceptual diagrams show- 
ing the outline configurations of the three-dimen- 25 
sional display according to a seventh embodiment 
of the invention; 

Fig. 27 is a conceptual diagram showing how a dis- 
tribution device works according to this embodi- 
ment; 30 
Figs. 28A to 28C are conceptual diagrams showing 
how images are moved according to this embodi- 
ment; 

Figs. 29A and 29B are schematic diagrams showing 
a method of moving images according to this em- 35 
bodiment; 

Figs. 30A and 30B are schematic diagrams showing 
a method of moving the displays according to this 
embodiment; 

Fig. 31 is a schematic diagram showing a method 40 
of moving the whole apparatus according to this 
embodiment; 

Figs. 32A to 32C are schematic diagrams showing 
a position detection method according to this em- 
bodiment; ^5 
Figs. 33A and 33B are schematic diagrams showing 
another position detection method according to this 
embodiment; 

Fig. 34 is a block diagram showing the concept of 
a three-dimensional display according to an eighth so 
embodiment of the invention; 
Figs. 35A to 35 D are schematic diagrams showing 
the principle of the three-dimensional display ac- 
cording to the eighth embodiment; 
Fig. 36 is a schematic diagram showing the outline 55 
configuration of the three-dimensional display ac- 
cording to the eighth embodiment; 
Fig. 37 is a schematic diagram showing the outline 



configuration of a three-dimensional display ac- 
cording to a ninth embodiment of the invention; 
Fig. 38 is a schematic diagram showing the outline 
configuration of a three-dimensional display ac- 
cording to a tenth embodiment of the invention; 
Fig. 39 is a schematic diagram showing the outline 
configuration of a three-dimensional display ac- 
cording to an eleventh embodiment of the invention; 
Fig. 40 is a schematic diagram showing the outline 
configuration of a three-dimensional display ac- 
cording to a twelfth embodiment of the invention; 
Fig. 41 is a schematic diagram showing the outline 
configuration of a three-dimensional display ac- 
cording to a thirteenth embodiment of the invention; 
Fig. 42 is a schematic diagram showing the outline 
configuration of a three-dimensional display ac- 
cording to a fourteenth embodiment of the inven- 
tion; 

Fig. 43 is a schematic diagram showing the method 
of generating two-dimensional images in the three- 
dimensional display according to the fourteenth em- 
bodiment; 

Fig. 44 is a schematic diagram showing the corre- 
spondence between pixels of a two-dimensional 
display and polarization varying elements of a po- 
larization varying device in the three-dimensional 
display according to the fourteenth embodiment; 
Fig. 45 is a schematic diagram showing the corre- 
spondence between pixels of a two-dimensional 
display and polarization varying elements of a po- 
larization varying device in the three-dimensional 
display according to the fourteenth embodiment; 
Fig. 46 is a schematic diagram showing a method 
of displaying a three-dimensional image in the 
three-dimensional display according to the four- 
teenth embodiment; 

Fig. 47 is a schematic diagram showing a method 
of displaying a three-dimensional image in the 
three-dimensional display according to the four- 
teenth embodiment; 

Fig. 48 is a schematic diagram showing a method 
of displaying a three-dimensional image in the 
three-dimensional display according to the four- 
teenth embodiment; 

Fig. 49 is a schematic diagram showing a method 
of displaying a three-dimensional image in the 
three-dimensional display according to the four- 
teenth embodiment; 

Fig. 50 is a schematic diagram showing the outline 
configuration of a three-dimensional display ac- 
cording to a fifteenth embodiment of the invention; 
Figs. 51 A and 51 Bare schematic diagrams showing 
a method of displaying a three-dimensional image 
in the three-dimensional display according to the fif- 
teenth embodiment; 

Fig. 52 is a schematic diagram showing one exam- 
ple of a polarizing type bifocal optical system that 
can be used in the three-dimensional display ac- 
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cording to each of the embodiments of the inven- 
tion; 

Fig. 53 is a schematic diagram showing the relation 
between incoming light and exit light in the polariz- 
ing type bifocal optical system shown in Fig. 52; s 
Fig. 54 is a schematic diagram showing another ex- 
ample of a polarizing type bifocal optical system that 
can be used in the three-dimensional display ac- 
cording to each of the embodiments of the inven- 
tion; 10 
Fig. 55 is a schematic diagram showing still another 
example of a polarizing type bifocal optical system 
that can be used in the three-dimensional display 
according to each of the embodiments of the inven- 
tion; is 
Fig. 56 is a schematic diagram showing an optical 
system that can be used instead of the polarizing 
beam splitter shown in Fig. 55; 
Fig. 57 is a cross-sectional view showing the outline 
configuration ol a twisted nemalic type polarization 20 
varying device that can be used in the three-dimen- 
sional display according to each of the embodi- 
ments of the invention; 

Fig. 58 is a schematic diagram showing the operat- 
ing principle of the twisted nematic type polarization 2S 
varying device shown in Fig. 57; 
Fig. 59 is a cross -sectional view showing the outline 
configuration of an in -plane type polarization vary- 
ing device that can be used in the three-dimensional 
display according to each of the embodiments of the 30 
invention; 

Fig. 60 is a schematic diagram showing the working 
principle of the in-plane type polarization varying 
device shown in Fig. 59; 

Fig. 61 is a schematic diagram showing Ihe outline 3S 
configuration of a homogeneous type polarization 
varying device that can be used in the three-dimen- 
sional display according to each of the embodi- 
ments of the invention; 

Figs. 62A to 62C are schematic diagrams showing 40 
light incident on the homogeneous type polarization 
varying device shown in Fig. 61 and an orientation 
of an alignment layer; 

Figs. 63A and 63B are schematic diagrams showing 
the operating principle of the homogenous type po- *s 
larization varying device shown in Fig. 61; 
Fig. 64 is a schematic diagram showing the princi- 
ple of a head-mounted display according to a nine- 
teenth embodiment of the invention; 
Fig. 65 is a schematic diagram showing a method so 
of generating two-dimensional images in the head- 
mounted display according to the nineteenth em- 
bodiment; 

Fig. 66 is a schematic diagram showing a method 
of displaying a three-dimensional image in the 55 
head-mounted display according to the nineteenth 
embodiment; 

Fig. 67 is a schematic diagram showing a method 



of displaying a three-dimensional image in the 
head-mounted display according to the nineteenth 
embodiment; 

Fig. 68 is a schematic diagram showing a method 
of displaying a three-dimensional image in the 
head-mounted display according to the nineteenth 
embodiment; 

Fig. 69 is a schematic diagram showing a method 
of displaying a three-dimensional image in the 
head-mounted display according to the nineteenth 
embodiment; 

Fig. 70 is a schematic diagram showing the princi- 
ple of a head-mounted display according to a twen- 
tieth embodiment of the invention; 
Fig. 71 is a schematic diagram showing a method 
of generating two-dimensional images in the head- 
mounted display according to the twentieth embod- 
iment; 

Fig. 72 is a schematic diagram showing a method 
of displaying three-dimensional images in Ihe head- 
mounted display according to the twentieth embod- 
iment; 

Fig. 73 is a schematic diagram showing a method 
of displaying three-dimensional images in the head- 
mounted display according to the twentieth embod- 
iment; 

Fig. 74 is a schematic diagram showing a method 
of displaying three-dimensional images in the head- 
mounted display according to the twentieth embod- 
iment; 

Fig. 75 is a schematic diagram showing a method 
of displaying three-dimensional images in the head- 
mounted display according to the twentieth embod- 
iment; 

Fig. 76 is a schematic diagram showing one exam- 
ple of an optical system that can be used in each of 
the embodiments of the invention; 
Fig. 77 is a schematic diagram showing another ex- 
ample of an optical system that can be used in each 
of the embodiments of the invention; 
Fig. 78 is a schematic diagram showing a further 
example of an optical system that can be used in 
each of the embodiments of the invention; 
Fig. 79 is a schematic diagram showing a further 
example of an optical system that can be used in 
each of the embodiments of the invention; 
Fig. 80 is a schematic diagram showing a further 
example of an optical system that can be used in 
each of the embodiments of the invention; 
Figs. 81 Aand 81 B are schematic diagrams showing 
three-dimensional displays according to a twenty- 
second embodiment of the invention; 
Figs. 82 A and 82B are schematic diagrams showing 
three-dimensional displays according to a twenty- 
third embodiment of the invention; 
Figs. 83Aand 83B are schematic diagrams showing 
three-dimensional displays according to a twenty- 
lourth embodiment of the invention; 
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Figs. 84A to 84E are schematic diagrams showing 
three-dimensional displays according to a twenty- 
fifth embodiment of the invention; 
Figs. 85A and85B are schematic diagrams showing 
three-dimensional displays according to a twenty- 
sixth embodiment of the invention; 
Figs. 86A to 86D are schematic diagrams showing 
three-dimensional displays according to a twenty- 
seventh embodiment of the invention; 
Figs. 87 A and 87B are schematic diagrams showing 
three-dimensional displays according to a twenty- 
eighth embodiment of the invention; 
Figs. 88A to 88C are schematic diagrams showing 
the principle of the invention; 
Fig. 89 is a schematic diagram showing the princi- 
ple of the invention; 

Figs. 90A and 90B are schematic diagrams showing 
the principle of the invention; and 
Figs. 91 A and 91 B are schematic diagrams showing 
a three-dimensional representation method accord- 
ing to a further embodiment of the invention. 

[0042] The present patent application claims the pri- 
ority from Japanese Patent Application Nos. 
1 39602/1 998, 262804/1 998, 280739/1 998, 
304374/1998, 326931/1998 and 60,393/1999 filed with 
the Japanese Patent Office. The Japanese Patent Ap- 
plication No. 326931/1998 has followed the necessary 
procedure in claiming the priority in Japan from the Jap- 
anese Patent Application No. 139602/1998. 
[0043] Therefore, embodiments described in this 
specification use, at paragraphs that contain the same 
descriptions of the above patent applications, the corre- 
sponding paragraph numbers used in these applica- 
tions. The paragraph numbers used in this specification 
are assigned with symbols as shown in a table below to 
distinguish between the applications. It should also be 
noted that descriptions under the assigned paragraph 
numbers use different drawing numbers and reference 
numbers from those of the above patent applications in 
order to make them distinguishable. 



Table 1 


Symbol 


Application number 


A 


326931/1998 (including 139602/1998) 


B 


262804/1998 


C 


280739/1998 


D 


304374/1998 


E 


60393/1999 


F 


New matters 
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20 



30 



35 



40 



[0044] Now, by referring to the accompanying draw- 
ings, embodiments of the present invention will be de- 
scribed in detail. 



45 



SO 



55 



[0045] Throughout the drawings, parts having the 
same functions are assigned like reference numbers 
and their explanations are not repeated. 
[0046] In the description of the embodiments, a word 
"plane - on which to put an image is used. This is similar 
in meaning to an image plane that is often used in optics. 
Means to realize such an image plane can obviously be 
realized by combining many optical devices, which in- 
clude a variety of optical elements, such as lens, total 
reflecting mirror, partial reflecting mirror, curved mirror, 
prism, polarizer and wavelength plate, and two-dimen- 
sional displays, such as CRT (cathode ray tube), liquid 
crystal display, LED (light emitting diode) display, plas- 
ma display, FED (field emission display), DMD (digital 
mirror display), projection type display and line drawing 
type display. 

[0047] Although this specification deals mainly with a 
case where a three-dimensional object is represented 
as two-dimensional images displayed on two planes, it 
is obvious that the similar effect can be expected when 
two or more planes are used. 



[A-0012] 
2S [Embodiment 1) 



[0048] Fig. 3 and Figs. 10A and 10B are schematic 
views for explaining the principle of a three-dimensional 
display according to a first embodiment of the present 
invention. 

[0049] As shown in Fig. 3, a plurality of planes, such 
as planes 101 , 102 (plane 1 01 is closer to the observer 
100 than plane 102) are provided in front of an observer 
100. To display a plurality of two-dimensional images on 
these planes an optical system 103 is constructed by 
using two-dimensional displays and a variety of optical 
elements (details will be given later). 
[0050] Examples of the two-dimensional displays 
may include CRT, liquid crystal display, LED display, 
plasma display, FED display, projection type display and 
line drawing type display, and examples of the optical 
elements may include lens, total reflecting mirror, partial 
reflecting mirror, curved mirror, prism, polarizer and 
wavelength plate. 

[0051] Then, as shown in Fig. 4, a three-dimensional 
object 1 04, which is to be presented to the observer 1 00, 
is projected onto the planes 101, 102 to generate imag- 
es 105, 106 (hereinafter referred to as two-dimensional 
images). 

[0052] The two-dimensional images can be formed by 
a variety of ways, which include a technique that uses 
two-dimensional images formed by photographing the 
object 1 04 by camera along the line of sight; a technique 
that synthesizes a plurality of two-dimensional images 
shot from different directions: or synthesizing and mod- 
eling techniques based on computer graphics. 
[0053] As shown in Fig. 3, these two-dimensional im- 
ages 1 05, 1 06 are displayed on the planes 1 01 , 1 02 re- 
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spectively so that they overlap each other by viewing 
from one point on the line of which passes through the 
right and left eyes of the observer 100. 
[0054] This can be achieved by placing the centers or 
gravity centers of the two-dimensional images 1 05, 1 06 5 
and by controlling a ratio of enlargement/reduction of 
each image. 

[A-0013) 

TO 

[0055] An important point of this embodiment is that, 
in the apparatus with the above configuration, the bright- 
ness of each of the images 105, 106 is changed accord- 
ing to the depth position of the three-dimensional object 

104 while keeping constant the overall brightness as is 
seen by the observer 100. 

[0056] One example method of changing the bright- 
ness is explained as follows. 

[0057] Here, since the drawings are monochrome, in 
following drawings, a part having high value in bright- 20 
ness is shown with high density except for Fig. 10A and 
10B 

[0058] When for example the three-dimensional ob- 
ject 104 is on the plane 101, the brightness of the two- 
dimensional image 105 on this plane is set equal to the 25 
brightness of the three-dimensional object 104 and the 
brightness of the two-dimensional image 106 is set to 
zero, as shown in Fig. 5. 

[0059] Next, when for example the three-dimensional 
object 104isslightlymovedawayfromtheobserver100 30 
and is located at a position slightly away from the plane 
101 and closer to the plane 102, the brightness of the 
two-dimensional image 105 is slightly lowered and the 
brightness of the two-dimensional image 106 is slightly 
raised, as shown in Fig. 6. 35 
[0060] When for example the object 1 04 is moved fur- 
ther away from the observer 100 and is located at a po- 
sition further away from the plane 101 and closer to the 
plane 102, the brightness of the two-dimensional image 

1 05 is further lowered and the brightness of the two-di- 40 
mensbnal image 106 is further raised, as shown in Fig. 

7. 

[0061] When the object 104 is on the plane 102, the 
brightness of the two-dimensional image 106 is set 
equal to the brightness of the object 1 04 and the bright- 45 
ness of the two-dimensional image 105 is set to zero, 
as shown in Fig. 8. 

[0062] By displaying in this manner, the observer 100 
is made to feel as if the object 104 is located between 
the planes 101 and 102 because of observer's physio- so 
logical or mental factors or optical illusion although what 
is actually shown to the observer is the two-dimensional 
images 105, 106. 

[0063] That is, when for example the two-dimensional 
images 107, 108 with almost equal brightness are dis- ss 
played on the planes 101 and 102, the object 104 looks 
as if it lies near to a middle point between the depth po- 
sitions of the planes 101, 102. 



[A-0014] 

[0064] Although the above description mainly con- 
cerns a method and apparatus which represents the 
depth position of the entire three-dimensional object 1 04 
by using two-dimensional images displayed on the 
planes 101, 102, for example, the first embodiment can 
apparently be used as a method and apparatus for 
showing the depth of a three-dimensional object itself. 
[0065] One such example is described below. 
[0066] First, the outline configuration of a three-di- 
mensional display according to this embodiment is as 
shown in Fig. 3, in which a plurality of planes, for exam- 
ple planes 101 , 102 (plane 101 is closer to an observer 
100 than plane 102), are set in front of the observer 100 
and in which an optical system 103 is constructed by 
using, for example, two-dimensional displays and a va- 
riety of optical elements to display a plurality of two-di- 
mensional images on these planes (details will be given 
in third and subsequent embodiments). 
[0067] Next, the three-dimensional object 104 to be 
presented to the observer 100 is shot in the direction of 
the line of sight of both eyes of the observer 1 00 to gen- 
erate, for instance, two-dimensional images 105, 106. 
[0068] Theso two-dimensional images 105, 106 are, 
as shown in Fig. 3, displayed on the planes 101 and 102 
respectively such that they overlap each other by view- 
ing from the point on the line of which passes through 
the right and left eyes of the observer. 
[0069] This can be realized by placing the centers or 
gravity centers of the two-dimensional images 105, 106 
and by controlling a ratio of enlargement/reduction of 
each image, as described earlier. 
[0070] Position setting of each image and enlarge- 
ment/reduction are executed by a computer connected 
with the two-dimensional display apparatus. 
[0071] An important point of this embodiment is that, 
in the apparatus with the above configuration, the bright- 
ness of each part of each of the images 105, 106 is 
changed according to the depth position of each part of 
the object 1 04 while keeping constant the overall bright- 
ness as seen by the observer 100. 
[0072] One example method of changing the bright- 
ness will be explained by referring to Figs. 9A and 9B 
for a case where two display planes are used. [A-0015] 
[0073] Fig. 9A represents an example image dis- 
played on a plane close to the observer 1 00, for exam- 
ple, on the plane 101 , and Fig. 9B represents an exam- 
ple image displayed on a plane remote from the observ- 
er 100, for example, on the plane 102. 
[0074] Referring to Figs. 9A and 9B that show a cake 
as an object, upper and lower surfaces of the cake (ob- 
ject) are almost flat, except for the candles stuck on the 
top, the wall surface is cylindrical, and the candles are 
arranged near the circumference of the upper surface 
of the cake. 

[0075] In the two-dimensional images 105, 106 in this 
case, on the upper and lower surfaces the upper parts 



is 



15 

represent the remote parts of the cake. On the wall sur- 
face, the central part of the wall surface corresponds to 
the near side of the cake, and as you go from the center 
toward the left and right, the surface position moves to- 
ward the far side. And the central part of the hidden wall 
surface, which is shown higher than the front wall sur- 
face, is located on the far side. 
[0076] In this case, the brightness on the upper and 
lower surfaces is progressively changed according to 
the depth position so that, as shown in Fig. 9A, on a 
plane close to the observer 100, or the plane 101 , a por- 
tion close to the observer 100 (a lower part of the two- 
dimensional image) has a higher brightness level and a 
portion remote from the observer (an upper part of the 
two-dimensional image) has a lower brightness level. 
[0077] Further, on a plane remote from the observer, 
or the plane 102, the brightness is progressively 
changed according to the depth position so that, as 
shown in Fig. 9B, a portion close to the observer (a lower 
part of the two-dimensional image) has a lower bright- 
ness level and a portion remote from the observer (an 
upper part of the two-dimensional image) has a higher 
brightness level. 

[0078] Next, the brightness of the cylindrical portion 
is also changed progressively according to its depth po- 
sition so that, on a plane close to the observer 100, or 
the plane 101, a portion close to the observer 100 
(around the center) has a higher brightness level and a 
portion remote from the observer (the near left and right 
end) has a lower brightness level, as shown in Fig. 9 A. 
[0079] On a plane remote from the observer 100, or 
the plane 102, the brightness is changed progressively 
so that, as shown in Fig. 9B, a portion close to the ob- 
server 100 (around the center) has a lower brightness 
level and a portion remote from the observer (the near 
left and right end) has a higher brightness level. 
[0080] By displaying in this manner, the observer 1 00 
is made to feel as if there is a cylindrical cake with almost 
flat top and bottom surfaces because of observer's 
physiological or mental factors or optical illusion al- 
though what is actually shown to the observer is two- 
dimensional images. 

[0081 ] Although this embodiment has taken as an ex- 
ample a cylindrical object with almost flat top and bottom 
surfaces, it is apparent that the similar effect can be ob- 
tained if the object has other shapes. 

[A-0016) 

[0082] In the embodiment 1, we have explained a 
case where the brightness of the two-dimensional im- 
ages displayed on two or more planes are changed 
while keeping the overall brightness as seen by the ob- 
server 100 constant. 

[0083] However, progressively lowering the overall 
brightness as seen by the observer 100 toward the rear 
to emphasize the solidity of the object is a common used 
technique in computer graphics. It is obvious that the 
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use of this technique also in this invention can promote 
the effect of the invention. One such example is shown 
in Figs. 10A and 10B. 

[0084] In Fig. 10A, the brightness of the floor is grad- 
s ually lowered toward the upper part of the Figure to 
make one feel as if the floor shown at the upper part of 
the Figure lies remote from the viewer in the depth di- 
rection. 

[0085] In Fig. 10B, the brightness of a chain (circular 
10 objects), in addition to the floor, is also lowered progres- 
sively toward the left to produce an effect that makes 
one perceive that the chain on the left side is far in the 
depth direction. 

[0086] As the means for calculating the degree of 
is such brightness reduction, there are many methods 
available, including a method that uses a formula B' = 
B x T0/T (T: distance from a viewing point, TO: distance 
from a viewing point to a reference plane) in calculating 
the brightness B* that produces the above effect with re- 
20 sped to the object's brightness B. 

[A-0017J 

[0087] It is apparent that the two-dimensional image 
zs plane in the embodiment 1 does not have to be a flat 
plane and can take other forms such as spherical, ellip- 
soidal or quadratic surfaces : or other complex curved 
surfaces and produce the similar effect. 
[0088] In the embodiment 1 , because, unlike the con- 
30 ventional method shown in Fig. 1 , there are at least two 
image display planes on the near and far sides of the 
optical illusion position, contradictions among the bin- 
ocular parallax, convergence and focusing - the prob- 
lem experienced with the conventional method - can be 
35 suppressed greatly, which in turn is expected to reduce 
eyestrains. 

[0089] Since the focus position is fixed at a position 
where the viewer looks at two or more planes at the 
same time, the problem of the conventional method is 

40 improved greatly. 

[0090] In this case, it is necessary to determine the 
depth distances of a plurality of the planes, the depth 
distances being within the range wherein blurring of the 
images obtained when the focus point is adjusted at the 

45 position of the object to be displayed on the depth direc- 
tion by viewing from the observer is less is less than one 
obtained when the focus points are adjusted at the plu- 
rality of the planes. 

[0091] Further, unlike the conventional method shown 
50 in Fig. 2, an object that exists at an intermediate position 
between the image planes, too, looks three-dimensional 
to the viewer and therefore the system of this embodi- 
ment offers the advantage of realistic solidity, not the 
kind of solidity presented by gathering sheet-divided 
55 depths. 

[0092] Further, because the embodiment 1 can also 
show an object present between a plurality of planes, it 
offers the advantage of being able to reduce the amount 
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of data greatly when performing a three-dimensional 
display. 

[0093] Further, because the embodiment 1 takes ad- 
vantage of human physiological or mental factors or op- 
tical illusion based only on brightness changes of imag- 
es, the embodiment does not require the use of a co- 
herent light source such as a laser and facilitates the 
color stereoscopic image representation. 
[0094] Further, since this invention does not include 
mechanical driving parts, it can suitably reduce the 
weight of and improve the reliability of the apparatus. 
[0095] The embodiment 1 mainly concerns a case 
where there are only two planes for displaying two-di- 
mensional images and where an object to be presented 
to the observer lies between the two planes. It is, how- 
ever, apparent that the similar configuration can be em- 
ployed if there are more planes or the object to be pre- 
sented is located at a different position. 
[0096] Further, in this embodiment, it is also apparent 
that a three-dimensional video image can be displayed 
by successively changing two-dimensional images. 

[N] 

[0097] When the described two-dimensional images 
are displayed to overlap by viewing from one point on 
the line which passes through the right and left eyes of 
the observer, in the case that especially, the one point 
between the right and left eyes of the observer is used 
as the point on the line which passes through the right 
and left eyes of the observer, reliability for obtaining an 
effect of three-dimensional consciousness is become 
bigger. 

[0098] If it says simply, the above effect is obtained in 
many people or in many cases. 
[0099] Further, the center point between the right and 
left eyes of the observer is used as the above one point, 
it is easy to obtain the above effect and has a merit that 
a size of double images in the right and left eyes gener- 
ated by planes 01 and 02 becomes smaller. 
[01 00] It is useful for change a depth or an inclination 
of the object to be recognized by enlarging or reducing 
the size of a horizontal direction. 
[0101] However, variety of the brightness in the two- 
dimensional images having same colors is described, 
when a color of the object to be displayed is purple, the 
object is made by using (mixing) a red display of one 
plane and a blue display of another plane, the brightness 
of the two planes being deferent. 
[0102] This is useful for matching a back ground im- 
age with the object in view of color matching when the 
color of the outline of the object is different from the color 
of the object itself though each displays provides 
strange feeling. 

[0103] For the purpose to obtain the above effect, it is 
important to have a common area of depth of the dis- 
tance between planes displaying the above two-dimen- 
sional images, the common area being within the range 



in case that the object is viewed by single eye at the 
position of the right eye or the left eye. 
[0104] If there is not common area the obserber feels 
the object far from the planes. 

5 

[A-0018] 

[Embodiment 2] 

10 [0105] Figs. 11 to 16 illustrate the principle of a three- 
dimensional display according to a second embodiment 
of the present invention. 

[0106] In the three-dimensional display of the second 
embodiment, as shown in Fig. 11, a plurality of planes, 

15 such as planes 111 and 112 (plane 111 is closer to an 
observer 110 than plane 112), are installed in front of 
the observer 1 1 0 and, to display a plurality of two-dimen- 
sional images on these planes, an optical system 11 3 is 
constructed by using two-dimensional displays and var- 

20 jous optical elements. 

[0107] Among the possible two-dimensional displays 
there are CRT, liquid crystal display, LED display, plas- 
ma display, FED display, projection type display and line 
drawing type display. Examples of the optical elements 

2S may include lens, total reflecting mirror, partial reflecting 
mirror, curved mirror, prism, polarizer and wavelength 
plate. 

[01 08] Then, as shown in Fig. 1 2, a three-dimensional 
object 114, which is to be presented to the observer 110, 
30 is projected onto the planes 1 1 1 , 1 1 2 to generate images 
115, 116 (two-dimensional images). 
[0109] The two-dimensional images 115, 116 can be 
formed by a variety of ways, which include a technique 
that uses two-dimensional images formed by photo- 
ns graphing the object 114 by camera along the line of 
sight; a technique that synthesizes a plurality of two-di- 
mensional images shot from different directions; or syn- 
thesizing and modeling techniques based on computer 
graphics. 

40 

[A-0019] 

[0110] As shown in Fig. 11, the two-dimensional im- 
ages 115, 116 are displayed on the planes 111 and 112 
45 respectively so that they overlap each other on the line 
of sight of ihe observer (this can be achieved by locating 
the centers or gravity centers of the two-dimensional im- 
ages 115, 116 on the line of sight). 
[0111] An important point of this embodiment is that 
50 the brightness of each image 115, 116 is changed ac- 
cording to a change over time of the depth position of 
the three-dimensional object 114 while keeping con- 
stant the overall brightness as seen by the observer 1 1 0. 
[0112] This is explained by taking an example case 
55 where the three-dimensional object 1 1 4 moves from the 
plane 111 to the plane 112 with elapse of time. 
[0113] As shown in Fig. 13, when the three-dimen- 
sional object 114 is on the plane 111, the brightness of 
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the two-dimensional image 115 on the plane 111 is set 
equal to that of the three-dimensional object 1 1 4 and the 
brightness of the two-dimensional image 116 on the 
plane 112 is set to zero. 

[0114] Next, as shown in Fig. 14, when the three-di- 
mensional object 1 1 4 progressively moves slightly away 
from the observer 110 and inches from the plane 111 
toward the plane 112 over time, the brightness of the 
two-dimensional image 1 1 5 is lowered slightly over time 
according to the movement in the depth position of the 
three-dimensional object 114 and at the same time the 
brightness of the two-dimensional image 116 is slightly 
raised over time. 

[0115] Next, as shown in Fig. 15, when the three-di- 
mensional object 114 moves further away from the ob- 
server 1 1 0 and inches from the plane 1 1 1 further toward 
the plane 1 1 2 over time, the brightness of the two-di- 
mensional image 115 is lowered further over time ac- 
cording to the movement in the depth position of the 
three-dimensional object 114 and at the same time the 
brightness of the two-dimensional image 116 is raised 
further over time. 

[0116] When, as shown in Fig. 16, the three-dimen- 
sional object 1 1 4 finally reaches the plane 1 1 2 over time, 
the brightness of the two-dimensional image 1 16 on the 
plane 112 is changed over time until it becomes equal 
to the brightness of the three-dimensional object 114 ac- 
cording to the movement in the depth position of the 
three-dimensional object 114 and at the same time the 
brightness of the two-dimensional image 115 on the 
plane 111 is changed over time until it becomes zero. 

[A-0021] 

[01 17] By displaying in this manner, the observer 1 1 0 
is made to feel as if the three-dimensional object 114 
moves over time from the plane 111 to the plane 112 in 
the direction of depth because of observer's physiolog- 
ical or mental factors or optical illusion although what is 
actually shown to the observer is two-dimensional im- 
ages 115, 116. 

[0118] While this embodiment describes a case 
where the three-dimensional object 114 moves over 
time from the plane 111 to the plane 112, it is obvious 
that the similar display effect can also be produced in 
cases where the object moves from an intermediate 
depth position between the planes 1 1 1 and 1 1 2 to the 
plane 112, where it moves from the plane 111 to an in- 
termediate depth position between the planes 111 and 
112, and where it moves from an intermediate position 
between the planes 1 1 1 and 1 1 2 to another intermediate 
position between the planes 111 and 112. 
[0119] Although this embodiment has described a 
case where there are only two planes on which to place 
two-dimensional images and the three-dimensional ob- 
ject 11 4 to be presented to the observer 1 1 0 moves be- 
tween the two planes, it is obvious that the similar con- 
figuration can be employed and the similar effect ex- 



pected even when the number of two-dimensional im- 
age display planes is more than two or when the three- 
dimensional object being presented moves crossing a 
plurality of planes. 

s [0120] Although this embodiment has described a 
case where one three-dimensional object 114 moves 
between two planes on which two-dimensional images 
are displayed, it is obvious that when a plurality of three- 
dimensional objects move, i.e., when the displayed two- 

10 dimensional images each include a plurality of object im- 
ages moving in different directions, the brightness of the 
object images displayed on the respective display 
planes needs only to be changed according to the mov- 
ing directions of the objects and the speeds of their 

is movements. 

[A-0022] 
[Embodiment 3] 

[0121] Figs. 1 7A and 1 7B illustrate the outline config- 
uration of a three-dimensional display according to a 
third embodiment of the invention. 
[0122] In the three-dimensional display of the third 
embodiment, as shown in Fig. 1 7 A, a plurality of two- 
dimensional displays 2a01 , 2a02, a total reflecting mir- 
ror 2a03 (e.g., reflect ivity/transmittivity = 100/0) and a 
partial reflecting mirror 2a04 (e.g., 
reflectivity/transmittivity = 50/50) are used to construct 
an optical system on which to place a plurality of two- 
dimensional images described in the previous first and 
second embodiments. 

[0123] By changing the arrangements of these con- 
stitutional components, it is possible to place an image 
plane 2a05 and an image plane 2a06 at different posi- 
tions in the direction of depth, the image plane 2a05 be- 
ing formed by reflecting the displayed image of the two- 
dimensional display 2a01 by the total reflecting mirror 
2a03 and passing it through the partial reflecting mirror 
2a04, the image plane 2a06 being formed by reflecting 
the displayed image of the two-dimensional display 
2a02 by the partial reflecting mirror 2a04. 
[01 24] This optical system uses only mirrors and thus 
has the advantage of less degradation of picture quality. 
[01 25] The two-dimensional displays 2a01 , 2a02 may 
use CRT, liquid crystal display, LED display, plasma dis- 
play. FED display, DMD display, projection type display 
and line drawing type display. 

[01 26] It is obvious that the similar effect of this inven- 
tion can be produced even when the total reflecting mir- 
ror 2a03 of this embodiment is replaced with a partial 
reflecting mirror, although this lowers the brightness of 
image of the two-dimensional display 2a01. 
[0127] While this embodiment has described a case 
where the order of depth positions of image planes are 
equal to the order of depth positions of the two-dimen- 
sional displays, it is apparent that the order of depth po- 
sitions of the image planes can be changed freely by 
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changing the distances from the total reflecting mirror 
or partial reflecting mirror to the respective twcndimen- 
sional displays. 

[A-0023] 

[0128] As shown in Fig. 1 7B, an optical system for ar- 
ranging a plurality of two-dimensional images described 
in the previous embodiments 1 and 2 can be constructed 
by directly arranging the two-dimensional display 2a01 
without using the total reflecting mirror 2a03 and by us- 
ing the partial reflecting mirror 2a04 (e.g., reflectivity/ 
transmittivity = 50/50). 

[0129] That is, the image plane 2a05, which is formed 
by passing the displayed image of the two-dimensional 
display 2a01 through the partial reflecting mirror 2a04, 
and the image plane 2a06, which is formed by reflecting 
the displayed image of the two-dimensional display 
2a02 by the partial reflecting mirror 2a04, can be located 
at different positions in the direction of depth. 

[A-0024] 

[0130] While this embodiment has described a case 
where the order of depth positions of the imago planes 
is equal to the order of the depth positions of the two- 
dimensional displays, it is obvious that the order of the 
depth positions of the image planes can be changed 
freely by changing the distances from the partial reflect- 
ing mirror to the respective two-dimensional displays. 
[0131] One example which can change the position 
of the image plane more flexibly by incorporating lens 
or the like in the optical system is shown in Figs. 18A 
and 18B. 

[01 32] As shown in Fig. 18A, by adding convex lenses 
2b07, 2b08 to the optical system, which comprises a plu- 
rality of two-dimensional displays 2b01 , 2b02 s a total re- 
flecting mirror 2b03 (e.g., reflectivity/transmittivity = 
100/0) and a partial reflecting mirror 2b04 (e.g., reflec- 
tivity/transmittivity = 50/50), in order to change the im- 
age position, it is seen that the positional relation be- 
tween the image plane 2b05 and the image plane 2b06, 
which has been restricted by the size of the displays, 
can be more flexibly set. 

[01 33] It is obvious that the similar effect of this inven- 
tion can be obtained even if the total reflecting mirror 
2b03 of this embodiment is replaced with a partial re- 
flecting mirror, although this lowers the brightness of an 
image of the two-dimensional display 2b01 . 
[01 34] While in this embodiment we have described 
a case where the order of depth positions of image 
planes is equal to the order of depth positions of two- 
dimensional displays, it is obvbus that the order of depth 
positions of image planes can be changed freely by 
changing the distances from the total reflecting mirror 
or partial reflecting mirror to the two-dimensional dis- 
plays or by installing lens or the like in the optical sys- 
tem. 



[A-0025] 

[01 35] Further, as shown in Fig. 8B, by adding convex 
lenses 2b07, 2b08 to the optical system, which includes 
5 the two-dimensional display 2b01 directly installed with- 
out using the total reflecting mirror 2b03 and also a par- 
tial reflecting mirror 2b04 (e.g., reflectivity/transmittivity 
= 50/50), to change the image position, it is seen that 
the positional relation between the image plane 2b05 

io and the image plane 2b06, which has been restricted by 
the size of the displays, can be more flexibly set. 
[01 36] As in the ordinary lens system, it may of course 
be advantageous in terms of distortion to use a combi- 
nation lens in additbn to convex lenses. 
[01 37] Further, although this embodiment has shown 
a case where virtual images are used which are formed 
by installing the two-dimensional displays at positions 
within a lens focal length, it is obvious that the invention 
can also be applied to a case where real images are 

20 used which are formed by installing the two-dimensional 
displays at positions outside the lens focal length. 
[0138] While this embodiment has described a case 
where the order of depth positions of image planes is 
equal to the order of depth positions of the two-dimen- 

25 sional displays, it is obvious that the order of depth po- 
sitions of image planes can be changed freely by chang- 
ing the distances from the partial reflecting mirror to the 
two-dimensional displays or installing lens or the like in 
the optical system. 

30 

[A-0026] 

[0139] Fig. 19 shows an example that uses an in- 
creased number of two-dimensional displays. 

35 [0140] In this case, a plurality of two-dimensional dis- 
plays 2c01, 2c02, 2c03, 2c04, 2c05, a total reflecting 
mirror 2c06 (e.g., reflectivity/transmittivity = 100/0) and 
partial reflecting mirrors 2c07 (e.g., reflectivity/transmit- 
tivity = 50/50), 2c08 (e.g., reflectivityAransmittivity = 

40 33.3/66.7), 2c09 (e.g., reflectivity/transmittivity = 25/75), 
2c10 (e.g., reflectivity/transmittivity = 20/80) are used to 
construct an optical system to arrange a plurality of two- 
dimensional images. 

[0141] By changing the arrangements of these con- 
45 stitutional components, it is possible to place an image 
plane 2c11 and image planes 2c12-2c15 at different po- 
sitions in the direction of depth, the image plane 2c 11 
being formed by reflecting the displayed image of the 
two-dimensional display 2c01 by the total reflecting mir- 
50 ror 2c06 and passing it through the partial reflecting mir- 
rors 2c07-2c10, the image planes 2c12-2c15 being 
formed by reflecting the displayed images of the two- 
dimensional displays 2c02-2c05 by the partial reflecting 
mirrors 2c07-2c10 and passing them through the partial 
55 reflecting mirrors. 

[0142] This optical system uses only mirrors and thus 
has the advantage of less degradation of picture quality. 
[0143] While this embodiment has described a case 
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where there are five two-dimensional displays, it is ap 1 
parent that the similar configuration can be adopted 
when a different number of two-dimensional displays 
are used. 

[0144] In this case also, it is obvious that adding lens 
systems as shown in Figs. 17 and 18 makes it easy to 
control the positions of image planes. 
[01 45] It is also obvious that replacing the total reflect- 
ing mirror 2c03 in this embodiment with a partial reflect- 
ing mirror will produce the similar effect to that of the 
invention, although this lowers the brightness of the im- 
age of the two-dimensional display 2c01 . 
[0146] While this embodiment has described a case 
where the order of depth positions of image planes are 
equal to the order of depth positions of the two-dimen- 
sional displays, it is apparent that the order of depth po- 
sitions of the image planes can be changed freely by 
changing the distances from the total reflecting mirror 
or partial reflecting mirror to the respective two-dimen- 
sional displays. 

[A-0027] 

[0147] Fig. 20 shows one example of an optical sys- 
tem for arranging a plurality of two-dimensional images 
which is constructed by using a plurality of projection 
type two-dimensional displays (for example, CRT type, 
LCD type, ILV type and DMD type) 2d01, 2d02, 2d03, 
2d04, 2d05 and scatter plates 2d06. 2d07, 2d08, 2d09, 
2d 1 0 and by projecting images from the projectors onto 
the scatter plates. 

[0148] Here, the scatter plates 2d06-2d10 may be 
such devices as can control scattering/transmission or 
reflection/transmission, such as polymer dispersed liq- 
uid crystal devices, holographic polymer dispersed liq- 
uid crystal devices or combined devices of liquid crystal 
and multi-lens array. Shutters 2dll-2d15 may be such 
devices as can control transmission/interruption, such 
as twisted nematic liquid crystal devices, ferroelectric 
liquid crystal devices or mechanical shutter devices. 
[0149] The scatter plates 2d06-2d10 are arranged at 
different depth positions, the focusing planes of the pro- 
jector type two-dimensional displays 2d01-2d05 are 
aligned with these scatter plates 2d06-2d1 0, images are 
projected onto the scatter plates, and the scattering/ 
transmission timing of the scatter plates 2d06-2d10 is 
synchronized with the transmission/interruption timing 
of the shutters 2d11-2d15 when activating the scatter 
plates and the shutters. This enables the depth positions 
of the image planes 2dll-2d15 formed on the scatter 
plates 2d06-2d1 0 to be controlled on a time division ba- 
sis. 

[0150] In this way, the use of projectors provides an 
advantage of enhanced level of Ireedom of display lay- 
out. 



[A-0028] 

[0151] Although this embodiment has described a 
case where there are five two-dimensional displays, the 

s similar configuration can be employed when a different 
number of displays are provided. 
[0152] It is obvious that the lamps of projectors can 
be turned on or off instead of using the shutters. 
[01 53] Further, although the third embodiment mainly 

10 concerns a case where the image planes are located 
near, within or beyond the three-dimensional display, 
these image planes can easily be located away from or 
in front of the three-dimensional display. One such ex- 
ample is shown in Fig. 21. 

is [0154] For example, it can easily be seen that by ar- 
ranging a lens system 3e03 in front of an optical system 
3e01 as shown in Fig. 21, the internal image planes 
3e02 can be moved to the positions of external image 
planes 3e04. 

20 [01 55] This offers the advantage that because the im- 
ages are reproduced floating in space, the images are 
more likely to look three-dimensional to the observer 
than when the images are located inside or behind the 
display. 

25 

[A-0029] 
[Embodiment 4] 

30 [0156] The fourth embodiment of the present inven- 
tion is an example in which the optical system in the pre- 
vious embodiments 1 , 2 for arranging a plurality of two- 
dimensional images is constructed by using a volumet- 
ric three-dimensional display. 

35 [0157] As described in "Three-Dimensional Display" 
(by Senju Masuda, published by Sangyo Tosho K.K.), 
the volumetric three-dimensional display performs 
three-dimensional image presentation by stacking two- 
dimensional images (same as the two-dimensional im- 

40 ages in the embodiment 1 ) sampled in the direction of 
depth. 

[0158] The volumetric three-dimensional display in- 
cludes a varifocal mirror type and a vibration screen 
type. 

45 [01 59] The varifocal mirror type, as shown in Fig. 22, 
transmits an image displayed on the two-dimensional 
204 such as television through a half mirror 201 and a 
varifocal mirror 202 to form a three-dimensional image 
(virtual image) for an observer 100. 

so [0160] The varifocal mirror 202, a key device in this 
method, is made by applying metal such as aluminum 
or multilayer dielectric on the surface of a woofer (low 
tone reproducing speaker) to form a concave mirror. 
When vibrated like an ordinary woofer, the concave mir- 

55 ror portion changes its curvature to change the focal 
length. 

[0161] Hence, the position of a virtual image or a real 
image of the two-dimensional display 204 can be 
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changed by changing the focal length. 
[0162] Therefore, by displaying images sampled in 
the direction of depth (two-dimensional images obtained 
by slicing a three-dimensional object at positions shifted 
in the direction of depth and sampling the sliced por- s 
tions) on the two-dimensional display 204 in synchro- 
nism with the change in the focal length of the varifocal 
mirror 202, it is possible to form a three-dimensional im- 
age on a time division basis (by taking advantage of the 
after image effect). io 
[0163] With this method and apparatus, this invention 
can provide a plurality of two-dimensional images by re- 
peating a short-duration activation of the two-dimen- 
sional display a number of times. 

[0164] The depth position of an image plane can be is 
specified by the vibration position of the varifocal mirror 
202. 

[01 65] Therefore, changing the brightness of the two- 
dimensional images described in the preceding embod- 
iments 1 , 2 and displaying the images on the image 20 
planes can produce the effect of this invention. 
[01 66] In addition to few moving parts, this method al- 
so has an advantage of being able to form a plurality of 
image planes easily. 

25 

[A-0030] 

[0167] The vibration screen type volumetric three-di- 
mensional display, as shown in Fig. 23, includes: a vi- 
bration screen (e.g., diffusion plate, lenticular plate and 30 
fly's eye lens) 301 that vibrates in the direction of depth; 
an optical system 302 including lens; a scanner for 
raster scanning a laser beam in horizontal and vertical 
directions (horizontal/vertical scanner comprising, for 
example, a light deflector using a polygon mirror and a 35 
galvanometer mirror) 303; and a laser light source 304. 
[0168] This method drives the scanner 303 at high 
speed when the vibration screen 301 is at a desired 
depth position, writes a sampled image corresponding 
to that depth position on the screen, and repeats this *o 
process by changing the depth position within the after 
image time, thereby reproducing a three-dimensional 
image. 

[01 69] With this method and apparatus, this embodi- 
ment can present a plurality of two-dimensional image *s 
planes by repeating within the after image time a proc- 
ess of writing the sample image on the vibration screen 
301 at high speed. 

[0170] The depth position of the image plane can be 
specified by the position of the vibration screen 301 . so 
[01 71] Hence, by changing the brightness of the two- 
dimensional images described in the preceding embod- 
iments 1 , 2 and displaying the images on these image 
planes, the effect of this invention can be produced. 
[01 72] This method has the advantages of being able ss 
to easily suppress distortions on the screen surface and 
easily form a plurality of image planes. 



[A-0031] 
[Embodiment 5] 

[0173] The fifth embodiment of the present invention 
is a rotary LED type three-dimensional display, which, 
as shown in Fig. 24, includes an LED display 401 having 
an LED array, a rotating device 402 for rotating the LED 
display 401 , and a video supply device 403 for feeding 
a video signal to the LED display 401 . 
[01 74] This method requires sampling a three-dimen- 
sional object in polar coordinates with the rotating axis 
of the LED display 401 as a center. 
[0175] The two-dimensional image sampled in the po- 
lar coordinates is displayed on the LED display 401 in 
synchronism with the rotation of the LED display 401 
and this process is repeated by changing the rotation 
angle to represent a three-dimensional image. 
[0176] With this method and apparatus, this embodi- 
ment can present a plurality of two-dimensional image 
planes by converting a desired two-dimensional image 
plane into the polar coordinates, displaying at high 
speed an image on LEDs at the converted position co- 
ordinates within the after image time, and repeating this 
process while changing the rotation angle. 
[0177] Then, by changing the brightness of the two- 
dimensional images described in the preceding embod- 
iments 1 , 2 and displaying the images on these image 
planes, the effect of this invention can be produced. 
[0178] This method offers the advantages of being 
able to easily suppress distortions on the screen sur- 
face, rotate the LED display 401 relatively easily, and 
easily form a plurality of image planes. 

[A-0032] 

[Embodiment 6) 

[01 79] The sixth embodiment of the present invention 
is a synthalyzer type three-dimensional display which, 
as shown in Fig. 25, includes a film recorded with two- 
dimensional images or a two-dimensional display (e.g., 
CRT and liquid crystal display) 501 , a conversion optical 
system such as prism and mirror 502, and a projection 
drum 503. Denoted 504 is a light source and 505 a shut- 
ter. 

[0180] The projection drum 503, a key device in this 
method, is made ol a transparent material (e.g., glass 
and acrylics or other transparent plastics) and has a var- 
ying thickness. The image of the film or two-dimensional 
display 501 is projected through the projection drum to 
display an image. 

[0181] This method utilizes the fact that as the projec- 
tion drum 503 is rotated, the drum thickness changes 
causing the position of the image plane to change. 
[01 82] Thus, by displaying images sampled in the di- 
rection of depth (two-dimensional images obtained by 
slicing a three-dimensional object at positions shifted in 
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the direction of depth and sampling the sliced portions) 
on the two-dimensional display 501 in synchronism with 
the change in the position of the image plane, it is pos- 
sible to form a three-dimensional image on a time divi- 
sion basis (by utilizing the after image effect). 
[0183] With this method and apparatus, this embodi- 
ment can present a plurality of two-dimensional image 
planes by repeating the short-duration displaying of the 
film or two-dimensional display a number of times within 
the after image time. 

[0184] The depth position of the image plane can be 
specified by the thickness of the projection drum. 
[0185] Therefore, by changing the brightness of the 
two-dimensional images described in the preceding em- 
bodiments 1 , 2 and displaying the images on these im- 
age planes, the effect of this invention can be obtained. 
[0186] In addition to few moving parts, this method 
has the advantage of being able to form a plurality of 
image planes easily. 

[0187] The invention realized by the inventor has 
been described in detail in conjunction with embodi- 
ments. It should be noted that the invention is not limited 
to these embodiments and that various modifications 
may be made without departing from the spirit of the in- 
vention. 

[A-0033] 

[0188] The advantages and effects obtained by the 
representative embodiments described above may be 
summarized briefly as follows. 

[A-0034] 

[01 89] Because a plurality of two-dimensional images 
obtained by slicing a three-dimensional object at posi- 
tions shifted in the direction of depth and sampling the 
sliced portions are displayed on planes 1 -N (N^2) hav- 
ing different depth positions from an observer and be- 
cause the brightness of each of the two-dimensional im- 
ages on respective planes is changed independently of 
each other, it is possible to suppress contradictions 
among physiological factors of stereoscopy, reduce the 
amount of information, and reproduce an electrically re- 
writable three-dimensional image. 

[B-0019] 

[Embodiment 7] 

[01 90] Figs. 26 A and 26B show a conceptual diagram 
showing the outline configuration of a three-dimensional 
display according to this embodiment. For components 
of the three-dimensional display of this embodiment that 
are identical with the corresponding components of the 
preceding embodiments 1 to 6, detailed explanations of 
their constructions and operations are omitted. 



[B-0020] 

[01 91] In the three-dimensional display of this embod- 
iment, as shown in Fig. 26A, a two-dimensional image 
s with depth information which was generated by a two- 
dimensional image generation device 1102 is distribut- 
ed into a plurality of images (in this case, five images) 
for different depth positions by a distributor 1103. The 
brightness for each of the distributed two-dimensional 
images with depth information is changed by a bright- 
ness change device 1104 according to the depth posi- 
tion of the image. The display elements are moved by 
a position change device (two-dimensional image 
change device) 1 105 to such positions that the axes of 
the images as seen from an observer overlap each oth- 
er, and the brightness changed images are displayed 
on the two-dimensional displays 1106-1110, thus pro- 
viding a three-dimensional representation. 

[B-0021] 

[01 92] Fig. 27 is a conceptual diagram showing the 
working of the distributor 1 1 03. An image 1 207 to be rep- 
resented between an image plane 1 202 and an image 
plane 1203 is displayed on the image plane 1202 and 
the image plane 1 203. An image 1 208 to be represented 
between image planes 1203 and 1204 is displayed on 
the image ptanes 1203 and 1204. Images to be repre- 
sented between image planes 1204 and 1205 and be- 
tween image planes 1 205 and 1 206 are displayed in the 
similar way. The image to be represented (for example, 
image 1 207) may be located at any position between 
the image planes 1202 and 1203. For the image 1209 
that is to be represented straddling an image plane (for 
example, image plane 1 204), a part to be shown in front 
of the image plane 1204 is displayed in the same way 
as the front image 1208 and a part to be shown behind 
the image plane 1204 is displayed in the same way as 
the rear image 1210. 

[B-0022] 

[0193] In Fig. 26B, a two-dimensional image with 
depth information which was generated by a two-dimen- 
sional image generation device 1122 is distributed into 
a plurality of images (in this case, five images) for dif- 
ferent depth positions by a distributor 1123. The bright- 
ness for each of the distributed two-dimensional images 
with depth information is changed by a brightness 
change device 1124 according to the depth position of 
the image. Displays 1 126-11 30 are moved by a position 
change device (two-dimensional image change device) 
1125 to such positions that the axes of the images as 
seen from an observer overlap each other, and the 
brightness changed images are displayed on these dis- 
plays 1126-1130 thus providing a three-dimensional 
representation. 
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[B-0023] 

[0194] Figs. 28A to 28C are conceptual diagrams 
showing how an image moves, according to this embod- 
iment. 5 
[0195] Fig. 28A shows a conceptual diagram for a 
case where a three-dimensional image is reproduced at 
around an intermediate part between two image planes 
1301 and 1302. When the observer views from a view- 
ing position of an observer 1 303, the images displayed w 
on the front and rear image planes are located at images 

1306 and 1309. When the viewing position of the ob- 
server 1 303 moves to a viewing position of an observer 
1 304, the image 1 306 is moved to a position of an image 

1 307 and the image 1 309 to a position of an image 1 31 1 is 
because the reproducing position of the three-dimen- 
sional image 312 must be fixed. When the viewing po- 
sition moves to a viewing position of an observer 1 305, 

the images are moved to positions of images 1 308 and 
1310 respectively. 20 

[B-0024] 

[0196] Fig. 28B is a conceptual diagram for a case 
where a three-dimensional image 1313 is reproduced 2s 
between two image planes 1 321 and 1 322 at a position 
close to the image plane 1 322. When the observer views 
from a viewing position of an observer 1 323, the images 
displayed on the front and rear image planes are located 
at images 1 326 and 1 329. 30 

[B-0025] 

[0197] When the viewing point of the observer 1323 
moves to a viewing position of an observer 1 324, the 35 
image 1326 is moved to a position of an image 1327 
and the image 1 329 is left almost at its position because 
the reproducing position of the three-dimensional image 
1313 needs to be fixed. When the viewing point moves 
to a viewing position of an observer 1325, the image 40 
1326 is moved to a position of an image 1328. 

[B-0026] 

[0198] Fig. 28C is a conceptual diagram for a case 45 
where a three-dimensional image 1314 is reproduced 
between two image planes 1 331 and 1 332 at a position 
close to the image plane 1 331 . When the observer views 
from a viewing position of an observer 1 333, the images 
displayed on the front and rear image planes are located so 
at images 1336, 1337. 

[B-0027] 

[0199] When the viewing point of the observer 1333 ss 
moves to a viewing position of an observer 1 334, the 
image 1337 is moved to a position of an image 1339 
and the image 1 336 is left almost at its position because 



30 

the reproducing position of the three-dimensional image 
1 31 4 needs to be fixed. Similarly, when the viewing point 
moves to a viewing position of an observer 1 335, the 
image 1 337 is moved to a position of an image 1 338. 

[B-0028] 

[0200] By combining the image moving methods of 
Figs. 28A to 28C according to the reproducing position 
of a three-dimensional image, it is possible to eliminate 
a double image caused by positional discrepancy be- 
tween the front and rear images even when the viewing 
point of an observer changes and to ensure that the po- 
sitions of gravity centers and outlines of the images on 
the front and rear image planes snugly overlap so that 
the observer can recognize the display as a represen- 
tation of a single object. 

[B-0029] 

[0201] Figs. 29 A and 29B are conceptual diagrams 
showing how the display elements are moved. 
[0202] One method of moving an image is, as shown 
in Figs. 29A and 29B, to move an image 1403 displayed 
on a two-dimensional display 401 vertically or horizon- 
tally, or to enlarge or reduce an image 1413 displayed 
on a two-dimensional display 411, or to combine these 
methods and electrically rewrite the display element. In 
that case, when a Figure needs to be deformed slightly 
(as by trapezoidal deformation) as when an observer 
moves greatly, the display element on the display is also 
changed at the same time. When the amount of move- 
ment of the image is small, such a change is not neces- 
sary as long as the displayed object looks natural to the 
observer. 

[B-0030] 

[0203] As the observer moves, the displayed image 
is rewritten into an image as it will appear when viewed 
from the observer, thus producing a movement parallax, 
too. For example, when the observer moves to the left, 
the displayed image is rewritten into an image as it will 
appear when viewed from the left viewing point corre- 
sponding to the position of the observer. By rewriting the 
image according to the change in position of the observ- 
er, the required movement parallax can be realized. For 
the vertical movement of the observer also, the corre- 
sponding movement parallax is produced by the similar 
method. 

[B-0031] 

[0204] Another method of moving the image, as 
shown in Figs. 30A, 30B and 31 , is to mechanically 
move two-dimensional displays. The mechanical mov- 
ing method includes: moving two-dimensional displays 
1501, 1502, 1503 (Fig. 30A); in a three-dimensional dis- 
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play having half mirrors, rotating the half mirrors 1514, 
1515 (Fig. 30B); and moving an entire three-dimension- 
al display 1601 (Fig. 31). 

[B-O032] 

[0205] When it is necessary to cause a slight defor- 
mation to a Figure (as by trapezoidal deformation), the 
display element on the display is also changed at the 
same time or corrections are made on an optical system 
such as prism. The optical system for corrections may 
include one of a prism, a lens and parallel plates, or a 
combination of these. When the amount of movement 
of an image is small, such a change need not be per- 
formed as bng as the displayed object looks natural to 
the observer. Mechanically moving the displays chang- 
es physical positions of the displays and thus can ex- 
pand a viewing zone. In the method of moving the entire 
three-dimensional display, the viewing zone can be ex- 
panded by making the movement follow the position of 
the observer. 

[B-0033] 

[0206] As a further image moving method, it is possi- 
ble to combine the display element moving method with 
the mechanical moving method. In this method, to follow 
a large movement of an observer, the image is moved 
by the mechanical moving method to expand the view- 
ing zone. To follow a small movement of an observer, 
the display element is moved. This combined method 
can simplify the moving apparatus, prevent the observer 
from feeling incongruous, and ensure swift movement 
of images. 

[B-0034] 

[0207] The movement of an observer may preferably 
be detected by determining the position of the observer 
relative to a three-dimensional display 701 by using an 
infrared sensor 1 702 as shown in Fig. 32A, an ultrasonic 
distance sensor or laser distance sensor 1 703 as shown 
in Fig. 32B and an optical sensor as shown in Fig. 32C. 
For detecting the position of a human using the above- 
described kinds of sensors, publicly known technologies 
may be used. Other known technologies may also be 
used, which include a method that detects the position 
of an observer from the image provided by a camera 
1805 as shown in Fig. 33A and a method that uses a 
magnetic sensor 1807 possessed by an observer or a 
magnetic sensor 1806 installed in the three-dimensional 
display to detect the position of an observer. 

[B-0035] 

[0208] The present invention has been described in 
detail in conjunction with embodiments and it should be 
noted, however, that the invention is not limited to these 



embodiments and that various modifications may be 
made without departing from the spirit of the invention. 

[B-0036] 

5 

[0209] The advantages of this embodiment may be 
briefly summarized as follows. 

(1 ) When the viewing point of an observer changes 
10 or when the observer moves, this embodiment can 

eliminate positional discrepancies between the 
front and rear display images or minimize the dis- 
crepancies to such an extent that the displayed ob- 
ject does not look unnatural, thus making it possible 
is to reproduce a three-dimensional image with no or 
little blur, which would otherwise be caused by de- 
viated overlapping of the front and rear images. 

(2) When the viewing point of an observer changes 
or when the observer moves, the two-dimensional 

20 images displayed on respective displays are 
changed according to the movement of the observ- 
er's viewing point. This can expand the viewing 
zone. 

(3) When the viewing point of an observer changes 
25 or when the observer moves, the displays or the 

three-dimensional display are moved according to 
the movement of the observer's viewing point. This 
can expand the viewing zone. 

30 [C-0013] 

[Embodiment 8] 

[0210] Fig. 34 is a block diagram showing a concept 
3S of a three-dimensional display according to this inven- 
tion. 

[0211] The three-dimensional representation method 
of this embodiment, too, has a plurality of image planes 
(display surfaces), for example image planes 2102, 

40 2103, set in front of an observer 2101 , as shown in Fig. 
34, and a plurality of two-dimensional images are dis- 
played on these image planes by using two-dimensional 
displays and an optical system. 
[0212] A three-dimensional object to be presented to 

45 the observer 2101 is projected onto the image planes 
2102, 2103 along the line of sight of both eyes of the 
observer to generate two-dimensional images. 
[0213] The two-dimensional images can be generat- 
ed by a variety of methods, which include one that uses 

so two-dimensional images of the object shot by camera 
from the line of sight, one that synthesizes a plurality of 
two-dimensional images shot from different directions, 
and one that uses a synthesizing technique or modeling 
technique based on computer graphics. 

55 

[C-0014] 

[0214] With this embodiment, when an object to be 
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presented is a plurality of objects located at different 
depth positions and overlapping each other on the line 
of sight of the observer 2101 , an image generator 2105 
generates for each of the objects to be presented two- 
dimensional images that are to be displayed simuttane- 5 
ously on a plurality of image planes, e.g., the image 
planes 2102, 2103. 

[0215] That is, in this embodiment, for each object to 
be displayed there are generated two-dimensional im- 
ages which are projected from the object onto the image 
planes 2102, 2103 from the line of sight of both eyes of 
the observer 2101. 

[C-0015] 

[0216] In this case, two-dimensional images to be dis- 
played at desired depth positions (two-dimensional im- 
ages for each of the objects to be presented) are gen- 
erated by the image generator 2105 shown in Fig. 34 in 
the order from the near depth position to the far depth 
position with respect to the observer, in the reverse or- 
der or in a random order. 

[0217] Then, the brightness of the generated two-di- 
mensional images to be displayed on the image planes 
2102, 2103 is changed by a brightness change device 
2104 to the brightness values corresponding to their 
depth positions, and the two-dimensional images thus 
generated are displayed on the image planes 2102, 
2103. 

[C-0016] 

[0218] A synchronizer 2106 synchronizes the depth 
positions for which the image generator 2105 generates 
the images with the depth positions for which the syn- 
chronizer 2106 changes the brightness of the images. 
That is, the images and their corresponding depth posi- 
tions are synchronized. 

[0219] The synchronizer 21 06 shown in Fig. 34 is con- 
ceptually illustrated, and the brightness can be changed 
either mechanically or by software. Two or more syn- 
chronizers 21 06 may be used. 
[0220] Further, the brightness change device 2104 
and the synchronizer 2106 may be constructed as one 
device. 

[C-0017] 

[0221] A method of displaying a three-dimensional 
image on the three-dimensional display according to 
this embodiment will be described by referring to Fig. 35. 
[0222] Step 2000: Two-dimensional images of an ob- 
ject that one wants reproduced at a front position as 
viewed from an observer, such as a three-dimensional 
image 2204, are changed in brightness by the bright- 
ness change device 2104 and the synchronizer 2106 
and then displayed on image planes 2202, 2203 to re- 
produce the three-dimensional image 2204. 



[0223] Step 2001: Next, two-dimensional images of 
an object that one wants reproduced at an intermediate 
position as viewed from an observer, such as a three- 
dimensional image 221 4, are changed in brightness and 
displayed on image planes 221 2, 221 3 to reproduce the 
three-dimensional image 2214. 
[0224] Step 2003: Next, two-dimensional images of 
an object that one wants reproduced at a rear position 
as viewed from an observer, such as a three-dimension- 
al image 2224, are changed in brightness and displayed 
on image planes 2222, 2223 to reproduce the three-di- 
mensional image 2224. 

[0225] Changing the brightness can be achieved by 
two methods: one is to change the brightness according 
to the three-dimensional image to be displayed and then 
display the image, and one is to change the brightness 
continuously while displaying the three-dimensional im- 
age. 

[0226] For example, the brightness of the front image 
plane may be changed from high to middle to low and 
the brightness of the rear image plane from low to middle 
to high so that the overall brightness as seen by the ob- 
server remains constant in order to change the position 
at which the three-dimensional image is reproduced 
from the front toward the rear. It is possible to reverse 
the brightness changing order. Another method is to 
change the brightness freely according to any desired 
position where a three-dimensional image is to be re- 
produced. 

[C-0018] 

[0227] This embodiment greatly differs from conven- 
tional techniques in that the steps 2000, 2001 and 2002 
in Fig. 35 are repeated at high speed during the display 
of image. 

[0228] Repeating the steps 2000, 2001 and 2002 of 
Fig. 35 at high speed allows the observer 2231 to see 
the three-dimensional images 2234, 2235, 2236 repro- 
duced at respective positions as shown in the state 2003 
and also to see the rear image through the front image. 
Here, 2232 and 2233 denote image planes and 2234, 
2235 and 2236 represent three-dimensional images re- 
produced. 

[0229] The speed at which the steps 2000, 2001 and 
2002 of Fig. 5 are repeated is set within the after image 
time of human eye, for example at 60 Hz or higher, to 
realize displaying of a three-dimensional image without 
flicker. 

[0230] That is, displaying two or more overlapping 
three-dimensional images can be achieved by perform- 
ing the image displaying procedures on a time division 
basis at high speed such that the resultant images are 
all displayed sequentially within the after image time of 
human eye. 

[0231] The number of brightness-changed two-di- 
mensional images for different depth positions needs to 
be greater than the maximum number of brightness- 
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changed images required to display the overlapping 
portions of the three-dimensional images. 

[C-0019] 

[0232] Fig. 36 is a schematic diagram showing the 
outline configuration of a three-dimensional display ac- 
cording to an eighth embodiment of the invention. 
[0233] In the three-dimensional display of this embod- 
iment, two-dimensional displays 2304, 2305 define the 
front and rear image planes respectively and the two- 
dimensional images displayed on the two image planes 
are arranged on the same optical axis by half mirrors 
2302, 2303. 

[0234] The images displayed on the two-dimensional 
displays 2304, 2305 are, as shown in Fig. 35, rapidly 
changed in brightness and displayed to the observer 
2301 repetitively. 

[0235] The two-dimensional displays 2304, 2305 may 
use CRT, liquid crystal display and plasma display and, 
when higher speed is required, can use displays using 
ferroelectric liquid crystals or antiferroelectric liquid 
crystals. 

[0236] Alternatively, it is possible to use a display that 
allows high-speed random access to individual pixels, 
such as a display of oscilloscope. 
[0237] In this case, the brightness levels of two-di- 
mensional images displayed on the two-dimensional 
displays 2304, 2305 are changed by the two-dimension- 
al displays 2304, 2305 themselves. 

[C-0021| 

[Embodiment 9] 

[0238] Fig. 37 is a schematic diagram showing the 
outline configuration of a three-dimensional display ac- 
cording to a ninth embodiment of the present invention. 
Reference number 2401 represents an observer, 2402 
and 2403 half mirrors, and 2404 and 2405 two-dimen- 
sional displays. 

[0239] The three-dimensional display of this embodi- 
ment differs from the three-dimensional display of the 
eighth embodiment in that the brightness of displayed 
images are changed by beam attenuating filters 2406, 
2407. 

[0240] The beam attenuating filters 2406, 2407 ac- 
cording lo this embodiment may be a filler that continu- 
ously changes its light intensity attenuation by mechan- 
ical rotation, a filter that electrically attenuates light in- 
tensity by liquid crystals, a device that has slits having 
changing opening areas and arranged in the direction 
of rotation and which mechanically rotates the slits to 
change the brightness, and a device which changes the 
opening time by a ferroelectric shutter to change the 
brightness. 

[0241] In the three-dimensional display of this embod- 
iment, the attenuation of the beam attenuating filters 



2406, 2407 is synchronized with the two-dimensional 
images displayed on the two-dimensional displays 
2404, 2405 to display a three-dimensional image. 

5 [C-0022] 

[Embodiment 10] 

[0242] Fig. 38 is a schematic diagram showing the 
10 outline configuration of a three-dimensional display ac- 
cording to a tenth embodiment of the invention. Refer- 
ence number 2501 represents an observer, 2502 and 
2503 half mirrors, 2504 and 2505 screens, 2506-2511 
twoKlimensional displays, and 2512-2517 shutters. 
'5 [0243] In the three-dimensional display of this embod- 
iment a plurality of projector type two-dimensional dis- 
plays 2506-2511 are used. 

[0244] For example, a two-dimensional display 2506 
displays a two-dimensional image for a front three-di- 

20 mensional image as viewed from an observer, a two- 
dimensional display 2507 displays a two-dimensional 
image for an intermediate three-dimensional image, and 
a two-dimensional display 2508 displays a two-dimen- 
sional image for a rear three-dimensional image. Shut- 

2S ters 2512-2514 are operated to project these two-di- 
mensional images sequentially on a time division basis 
onto a screen 2504. 

[0245] Similarly, a two-dimensional display 2509 dis- 
plays a two-dimensional image for a front three-dimen- 

30 sional image as viewed from an observer, a two-dimen- 
sional display 2510 displays a two-dimensional image 
for an intermediate three-dimensional image, and a two- 
dimensional display 2511 displays a two-dimensional 
image for a rear three-dimensional image. Shutters 

35 2515-2517 are operated to project these two-dimen- 
sional images sequentially on a time division basis onto 
a screen 2505. 

[0246] Then, the two-dimensional images displayed 
on the screens 2504, 2505 are arranged on the same 

40 optical axis by half mirrors 2502, 2053. 

[0247] In this embodiment, the brightness of each of 
the two-dimensional images projected from the two-di- 
mensional displays 2506-2511 is preset to a desired 
brightness level corresponding to the depth position of 

45 the two-dimensional image displayed. 

[C-0023] 
[Embodiment 11 ) 

so 

[0248] Fig. 39 is a schematic diagram showing the 
outline configuration of a three-dimensional display ac- 
cording to a eleventh embodiment of the invention. Ref- 
erence number 2601 represents an observer, 2602 and 
55 2603 half mirrors, 2604 and 2605 screens, 2606-2611 
two-dimensional displays, 2612-1617 shutters, and 
2618-2623 beam attenuating filters. 
[0249] The three-dimensional display of this embodi- 
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ment differs from the three-dimensional display of the 
preceding tenth embodiment in that the brightness of 
each of the two-dimensional images displayed on the 
two-dimensional displays 2606-2611 is changed by 
beam attenuating filters 2618-2623 installed at the front 
of the two-dimensional displays 2606-2611. 
[0250] For example, when three three-dimensional 
images are reproduced at positions shifted in the direc- 
tion of depth by using the two-dimensional displays 
2606-2608 that display two-dimensional images on the 
front image plane and the two-dimensional displays 
2609-2611 that display two-dimensional images on the 
rear image plane, the brightness of each two-dimen- 
sional display can be set constant and therefore the 
beam attenuating filters 261 8-2623 may have fixed lev- 
els of attenuation. 

[C-0024] 

[0251] When three or more three-dimensional images 
are reproduced at positions shifted in the direction of 
depth, the beam attenuating filters 2618-2623 may be 
a filter that continuously changes its light intensity atten- 
uation by mechanical rotation, a filter that electrically at- 
tenuates light intensity by liquid crystals, a device that 
has slits having changing opening areas and arranged 
in the direction of rotation and which mechanically ro- 
tates the slits to change the brightness, and a device 
which changes the opening time by a ferroelectric shut- 
ter to change the brightness. 

[0252] The attenuation of the beam attenuating filters 
2618-2623 is synchronized with the two-dimensional 
images projected from the two-dimensional displays 
2606-2611 to produce three-dimensional images. 

[C-0025] 

[Embodiment 12] 

[0253] Fig. 40 is a schematic diagram showing the 
outline configuration of a three-dimensional display ac- 
cording to a twelfth embodiment of the present inven- 
tion. Reference numeral 2701 denotes an observer, 
2702-2707 half mirrors, 2708-2713 two-dimensional 
displays, and 2714-2719 shutters. 
[0254] In the three-dimensional display of this embod- 
iment, the light axes of the two-dimensional displays 
2708-2710 are aligned wilh each other by the hall mir- 
rors 2704, 2705, and the two-dimensional images dis- 
played on the two-dimensional displays 2708-2710 are 
projected onto the Iront image plane by the shulters 
271 4-2716 on a time division basis. The light axes of the 
two-dimensional displays 2711-2713 are aligned with 
each other by the half mirrors 2706, 2707, and the two- 
dimensional images displayed on the two-dimensional 
displays 2711-2713 are projected onto the rear image 
plane by Ihe shutters 2717-2719 on a time division ba- 
sis. 



[C-0026] 

[0255] For the two-dimensional displays 2708-2713, 
a CRT, a liquid crystal display and a plasma display may 
5 be used. When a faster speed is required, a display us- 
ing ferroelectric liquid crystals or antiferroelectric liquid 
crystals may be used. 

[C-0027] 

10 

[0256] Alternatively, it is possible to use a display that 
allows high-speed random access to individual pixels, 
such as a display of oscilloscope. 
[0257] In this case, the brightness levels of two-di- 
mensional images displayed on the two-dimensional 
displays 2708-271 3 are changed by the two-dimension- 
al displays 2708-271 3 themselves. 



[0258] Fig. 41 is a schematic diagram showing the 
outline configuration of a three-dimensional display ac- 
2B cording to a thirteenth embodiment of the invention. Ref- 
erence number 2801 denotes an observer, 2802-2807 
half mirrors, 2808-2813 two-dimensional displays, 
2714-2719 shutters and 2720-2725 beam attenuating 
filters. 

30 [0259] The three-dimensional display of this embodi- 
ment differs from the three-dimensional display of the 
preceding twelfth embodiment in that the brightness of 
each of the two-dimensional images displayed on the 
two-dimensional displays 2808-281 3 is changed by the 

35 beam attenuating filters 2720-2725 disposed at the front 
of the two-dimensional displays 2808-2813. 
[0260] For example, when three three-dimensional 
images are reproduced at positions shifted in the direc- 
tion of depth by using the two-dimensional displays 

40 2808-2810 that display two-dimensional images on a 
front image plane and the two-dimensional displays 
2811-2813 that display two-dimensional images on a 
rear image plane, the brightness of each two-dimen- 
sional display can be set constant and therefore the 

45 beam attenuating filters 2720-2725 can use fixed levels 
of attenuation. 

[C-0029] 

50 [0261] When three or more three-dimensional images 
are reproduced at positions shifted in the direction of 
depth, the beam attenuating filters 2720-2725 may be 
a filter that continuously changes its light intensity atten- 
uation by mechanical rotation, a filter that electrically at- 
55 tenuates light intensity by liquid crystals, a device that 
has slits having changing opening areas and arranged 
in the direction of rotation and which mechanically ro- 
tates the slits to change the brightness, and a device 



[C-0028] 

20 

[Embodiment 1 3] 
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which changes the opening time by a ferroelectric shut- 
ter to change the brightness. 

[0262] The attenuation of the beam attenuating filters 
2720-2725 is synchronized with the two-dimensional 
images projected from the two-dimensional displays 
2808-2813 to produce three-dimensional images. 

[C-0030J 

[0263] The invention has been described in detail in 
conjunction with embodiments. It should be noted, how- 
ever, that the invention is not limited to the embodiments 
but various modifications may be made without depart- 
ing from the spirit of the invention. 

[C-0031) 

[0264] The advantages and effects produced by the 
representative embodiments described in this specifica- 
tion may be summarized briefly as follows. 

[C-0032] 

[0265] With this invention, a plurality of objects which 
have different depth positions and overlap each other 
on the line of sight of an observer can be represented 
by three-dimensional images in such a way that all the 
three-dimensional images can be seen by the observer 
without being hidden by the front images. 

[D-0020] 

[Embodiment 14] 

[0266] The three-dimensional display according to a 
fourteenth embodiment of the present invention repre- 
sent the overall depth position of the entire three-dimen- 
sional object between a plurality of image focusing 
planes. 

[0267] Fig. 42 shows the outline configuration of the 
three-dimensional display of the fourteenth embodiment 
of the invention. This three-dimensional display includes 
a two-dimensional display 3100, a polarization varying 
device 31 01 and a polarization type bifocal optical sys- 
tem 3102. 

[0268] The display light of a two-dimensional image 
displayed on the two-dimensional display 3100 is split 
and displayed onto two image focusing planes (in Fig. 
42, image focusing planes 3103 and 3104) of the polar- 
ization type bifocal optical system 3102 at a brightness 
ratio that depends on a polarization direction of exit light 
from the polarization varying device 3101. 
[0269] When the polarization direction of exit light 
agrees with one of intrinsic polarization directions 
(meaning two independent polarization directions) Pll of 
the polarization type bifocal optical system 3102, the 
two-dimensional image displayed on the two-dimen- 
sional display 3100 is focused on, for example, the im- 



40 

age focusing plane 3103. When the polarization direc- 
tion of the exit light matches the other intrinsic polariza- 
tion direction P1 2, the two-dimensional image displayed 
on the two-dimensional display 3100 is focused on the 

s image focusing plane 3104. 

[0270] When the polarization direction is other than 
these two intrinsic polarization directions (including lin- 
ear polarization, circular polarization, elliptical polariza- 
tion, etc.), the brightness levels of the image focusing 

10 planes 3103 and 3104 are set according to a ratio of 
components of the exit light polarization direction as pro- 
jected onto the orthogonal intrinsic polarization direc- 
tions. 

is [D-0021] 

[0271] Among the two-dimensional displays 31 00 are 
a CRT display, a liquid crystal display, an LED display, 
a plasma display, an FED display, a projection type dis- 
play and a line drawing type display. 
[0272] An example of the polarization varying device 
31 01 includes a device using liquid crystals and a device 
using PLZT which has birefringence and can control the 
birefringence by an electric field. These devices will be 
described later. 

[0273] Further, an example of the polarization type bi- 
focal optical system 3102 includes a device using liquid 
crystals and a device which has two optical systems with 
image focusing planes different from those of the polar- 
ization beam splitter or two optical systems with image 
focusing planes different from those of the beam splitter 
and the polarizer These devices will be described later. 

[D-0022] 

[0274] The basic operation of the three-dimensional 
display of this embodiment will be explained. 
[0275] In the three-dimensional display of this embod- 
iment, as shown in Fig. 43, a three-dimensional object 
3106 to be presented to an observer 3105 is projected 
along the line of sight of both eyes of the observer 3105 
onto image focusing planes 3103, 3104 to form two-di- 
mensional images 3107, which are then displayed on 
the two-dimensional displays 3100 shown in Fig. 42. 
[0276] The two-dimensional images 3107 may be 
generated in a variety of ways, which include a method 
that uses two-dimensional images of the three-dimen- 
sional object 3106 shot by camera from the direction of 
line of sight; a method that synthesizes a plurality of two- 
dimensional images shot from different directions; or a 
method that uses synthesizing and modeling tech- 
niques based on computer graphics. 

[D-0023] 

[0277] Each polarization varying element of the polar- 
ization varying device 3101 is related to one or more 
groups of pixels on the two-dimensional display 3100. 
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[0278] For example, as shown in Fig. 44, one pixel 
3110 of the two-dimensional display 3100 is related to 
one polarization varying element 3111 of the polariza- 
tion varying device 3101. Or, as shown in Fig. 45. a plu- 
rality of pixels 120 of the two-dimensional display 3100 
are related to one polarization varying element 3121 of 
the polarization varying device 3101. 

[D-0024] 

[0279] Next, the exit light polarization direction of the 
polarization varying element (for example, 3111 of Fig. 
44 or 3121 of Fig. 45) of the polarization varying device 
3101 is changed according to the depth position of that 
part of the three-dimensional object 3106 which corre- 
sponds to the associated pixel (e.g., 3110 in Fig. 44) or 
pixels (e.g., 3120 in Fig. 45) of the two-dimensional dis- 
play 3100. 

[0280] This causes two-dimensional images with 
brightness levels corresponding to Ihe exit light polari- 
zation direction to be displayed on the image focusing 
planes 3103 and 3104. 

[0281] The positional relation of the image focusing 
planes 3103, 3104 is adjusted in advance by using an 
appropriate optical system so that the images on the im- 
age focusing planes 3103, 3104 overlap each other on 
the line of sight of the observer 3105. 
[0282] Overlapping the images of the image focusing 
planes 3103, 3104 on the line of sight of the observer 
3105 can be realized by putting the centers or gravity 
centers of the two-dimensional images 3107 on the line 
of sight. 

[D-0025] 

[0283] The essential point of the three-dimensional 
display of this embodiment is that, by changing the exit 
light polarization direction of each polarization varying 
element of the polarization varying device 3101, the 
brightness of each part of the images on the image fo- 
cusing planes 3103, 3104 is changed according to the 
depth position of the three-dimensional object 3106 
while keeping constant the overall brightness as seen 
by the observer 3105. 

[0284] One example method of changing the bright- 
ness is explained below by referring to Figs. 46 to 49. 
[0285] It is assumed that the image focusing plane 
3103 is located closer to the observer 31 05 lhan the im- 
age focusing plane 3104 and that the intrinsic polariza- 
tion directions of the polarization type bifocal optical sys- 
tem 3102 for the image focusing planes 3103, 3104 are 
taken as pit and p12. 

[0286] As shown in Fig. 46, when the exit light polar- 
ization direction of each polarization varying element of 
the polarization varying device 3101 coincides with pll, 
the brightness of the image on the image focusing plane 
3103 becomes equal to the brightness of the three-di- 
mensional object 3106 and the brightness of the image 



on the image focusing plane 3104 becomes zero, thus 
representing the three-dimensional object 3106 posi- 
tioned on the image focusing plane 3103. 
[0287] Next, as shown in Fig. 47, as the exit light po- 
5 larization direction of each polarization varying element 
of the polarization varying device 3101 is tilted from pll, 
the brightness of the image on the image focusing plane 
3103 slightly lowers from that of Fig. 46 and the bright- 
ness of the image on the image focusing plane 3104 
increases, thus representing the three-dimensional ob- 
ject 3106 that has moved slightly away from the image 
focusing plane 3103 toward the image focusing plane 
3104. 



[0288] Further, as shown in Fig. 48, when the exit light 
polarization direction of each polarization varying ele- 
ment of the polarization varying device 3101 is further 
tilted from thai shown in Fig. 47, the brightness of the 
image on the image focusing plane 3103 further de- 
creases from that of Fig. 47 and the brightness of the 
image on the image focusing plane 31 04 further increas- 
es, thus representing a situation where the three-dimen- 
sional object 3106 has moved further away from the im- 
age focusing plane 3103 toward the image focusing 
plane 3104. 

[0289] Finally, as shown in Fig. 49, when the exit light 
polarization direction of each polarization varying ele- 
ment of the polarization varying device 3101 coincides 
with p12, the brightness of the image on the image fo- 
cusing plane 3104 becomes equal to the brightness of 
the three-dimensional object 31 06 and the brightness of 
the image on the image focusing plane 3103 becomes 
zero, thus representing a situation where the three-di- 
mensional object 3106 is on the image focusing plane 
3104. 

[D-0027] 

[0290] With the above representation method, the ob- 
server 3105 perceives the three-dimensional object 
3106 to be located between the image focusing planes 
3103 and 3104 because of observer's physiological or 
mental factors or optical illusion although the imagesare 
actually displayed on the image focusing planes 3103, 
3104. 

[0291 ] Because, unlike the conventional three-dimen- 
sional display, the three-dimensional display of this em- 
bodiment has at least two image displaying planes on 
the near and far sides of the optical illusion position, it 
is possible to suppress contradictions among the binoc- 
ular parallax, convergence and focusing - the problem 
experienced with the conventional three-dimensional 
display - which in turn is expected to reduce eyestrains. 
[0292] Further, because, unlike the conventional 
three-dimensional display, the three-dimensional object 
even at an intermediate position between the image 



1S [D-0026] 



20 



25 



30 



35 



40 



45 



SO 



43 



EP 0 959 377 A2 



44 



planes appears three-dimensional to the observer, this 
embodiment has the advantage of being able to provide 
a realistic three-dimensional image representation, not 
the kind of conventional solidity presented by gathering 
sheet-divided depths. s 
[0293] The three-dimensional display o1 this embodi- 
ment also has the advantage of being able to significant- 
ly reduce the amount of data required for three-dimen- 
sional representation because it can represent even a 
three-dimensional object disposed between a plurality 10 
of planes. 

[D-0028) 

[0294] Because the three-dimensional display of this '5 
embodiment utilizes human physiological or mental fac- 
tors or optical illusion based on changes in image bright- 
ness: there is an advantage that a coherent light source 
such as a laser is not required and that a color stereo- 
scopic image representation can be easily realized. 20 
[0295] Further, because the three-dimensional dis- 
play of this embodiment does not include mechanical 
driving parts, it has the advantage of light weight and 
improved reliability. 

[0296] Further, because the two-dimensional repre- 25 
sentation is achieved by the two-dimensional display 
3100 and the depthwise representation is achieved by 
the polarization varying device 3101, this embodiment 
has the advantage of simple control. 
[0297] Further, because the resolutions of images can 30 
be differentiated, the amount of information can be re- 
duced. That is, in view of the fact that the resolution re- 
quirement for the depth direction is lower than that for 
the two-dimensional direction, it may be an effective 
method to reduce the resolution in the depth direction. 3S 

[D-0029] 

[0298] In the three-dimensional display of this embod- 
iment, the size of the device is not restricted by the po- 40 
sition, interval and size of the image focusing planes. 
[0299] That is, it is possible to locate the image focus- 
ing planes 3103, 3104 at the front side of the three-di- 
mensional display as virtual planes by an optical sys- 
tem, or at the rear side by another optical system. 
[0300] The image focusing planes 3103. 3104 can be 
spaced apart a greater distance than in this embodiment 
by an optical system. 

[0301] Further, the size of the formed images can also 
be made larger than in this embodiment by an optical S( > 
system. 

[0302] Thus, compared with a method in which dis- 
plays are actually arranged, this embodiment has the 
advantage of being able to reduce the overall size of the 
three-dimensional display. ss 



[D-0030] 

[0303] The above description concerns a case where 
the brightness levels of the two-dimensional images 
3107 on a plurality of image focusing planes 3103, 3104 
are changed while keeping constant the overall bright- 
ness as seen by the observer. It is a common technique 
employed in computer graphics to progressively reduce 
the overall brightness as seen by the observer 3105 to- 
ward the far side in order to make the image look solid. 
It is obvious that the use of this technique also in this 
embodiment can further enhance the three-dimensional 
effect. 

[0304] Sequentially changing the two-dimensional 
images 31 07 and the polarization direction of the display 
light of the two-dimensional images 3107 and throwing 
it onto a plurality of image focusing planes 3103, 3104 
at different depth positions can generate a three-dimen- 
sional video image. 

[0305] While this embodiment has described a case 
where the three-dimensional object 3106 to be repre- 
sented is displayed as two-dimensional images on two 
image focusing planes 3103, 3104, it is apparent that 
the similar effects can be expected if more than two im- 
age focusing planes are used. 

[0306] This embodiment has described only the basic 
configuration and it is apparent that aberration can be 
reduced by adding optical systems. 
[0307] Further, this embodiment has described a case 
where an observer 3105 is located at the front center of 
the three-dimensional display. If the observer 310 is lo- 
cated at other positions, it is apparent that the similar 
effects can easily be produced by changing or adding 
optical systems. 

[D-0031] 

[Embodiment 15] 

[0308] The three-dimensional display according to a 
fifteenth embodiment of the invention differs from the 
preceding embodiment in that the three-dimensional 
display represents the depth ol the three-dimensional 
object itself. 

[0309] Fig. 50 shows the outline configuration of the 
three-dimensional display of the fifteenth embodiment 
of the invention. The three-dimensional display, as with 
the fourteenth embodiment, includes a two-dimensional 
display 3200, a polarization varying device 3201 and a 
polarization type bifocal optical system 3202. 
[0310] In the three-dimensional display of this embod- 
iment, too, the display light of a two-dimensional image 
displayed on the two-dimensional display 3200 is split 
and displayed onto two image focusing planes (in Fig. 
50, image focusing planes 3203 and 3204) of the polar- 
ization type bifocal optical system 3202 at a brightness 
ratio that depends on a polarization direction of exit light 
from the polarization varying device 3201. 
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[D-0032] 

[0311] The basic operation of the three-dimensional 
display of this embodiment will be explained as follows. 
[0312] First, the two-dimensional images 3207 of a 
three-dimensional object to be represented are dis- 
played on the two-dimensional display 3200. 
[0313] Then, as shown in Figs. 44 and 45, each po- 
larization varying element of the polarization varying de- 
vice 3201 is related to one or more pixels of the two- 
dimensional display 3200. 

[0314] Next, the exit light polarization direction of the 
related polarization varying element is changed accord- 
ing to the depth position of that part of the three-dimen- 
sional object which corresponds to the associated pixel 
(e.g., 3110 in Fig. 44) or pixels (e.g., 3120 in Fig. 45) of 
the two-dimensional display 3200. 
[0315] This causes two-dimensional images with 
brightness levels corresponding to the exit light polari- 
zation direction to be displayed on the image focusing 
planes 3203 and 3204. 

[0316] The positional relation of the image focusing 
planes 3203, 3204 is adjusted in advance by using an 
appropriate optical system so that the images on the im- 
age focusing planes 3203, 3204 overlap each other on 
the line of sight of the observer 3205. 

[D-0033] 

[0317] The essential point of the three-dimensional 
display of this embodiment is that, by changing the exit 
light polarization direction of each polarization varying 
element of the polarization varying device 3201 , the 
brightness of each part of the images on the image fo- 
cusing planes 3203, 3204 is changed according to the 
depth position of each part of the three-dimensional ob- 
ject while keeping constant the overall brightness as 
seen by the observer 3205. 

[0318] One example method of changing the bright- 
ness is explained below by referring to Figs. 51 A and 
51 B. 

[0319] Fig. 51 A show an example image formed on 
an image focusing plane close to the observer, for ex- 
ample image focusing plane 3203, and Fig. 51 B repre- 
sents an example image formed on an image focusing 
plane remote from the observer, tor example image fo- 
cusing plane 3204. 

[0320] When a cake, as shown in Figs. 51 A and 51 B, 
is taken as an example object, the top and bottom sur- 
faces of the cake is almost flat except for candles stuck 
on the top, the wall surface is cylindrical, and the candles 
are arranged near the circumference of the top surface 
of the cake. 

[0321] As shown in Figs. 51 A and 51 B, in the two-di- 
mensional images 3207, on the top and bottom surfaces 
the upper parts represent the remote parts of the cake. 
On the wall surface, the central part of the wall surface 
corresponds to the near side of the cake, and as you go 



from the center toward the left and right, the surface po- 
sition moves toward the far side. And the central part of 
the hidden wall surface, which is shown higher than the 
front wall surface, is located on the far side. 
5 [0322] In this case, polarization direction of each part 
needs to be changed by considering the two intrinsic po- 
larization directions of the polarization type bifocal opti- 
cal system 3202 so that the brightness levels of the im- 
age focusing planes 3203, 3204 will change as follows. 

w 

[D-0034] 

[0323] First, the brightness on the top and bottom sur- 
faces is progressively changed according to the depth 
is position so that, as shown in Fig. 51 A, on an image fo- 
cusing plane 3203 close to the observer 3205 a portion 
close to the observer 3205 (a lower part of the two-di- 
mensional image 3207) has a higher brightness level 
and a portion remote from the observer (an upper part 
of the two-dimensional image 3207) has a lower bright- 
ness level. 

[0324] Further, on an image focusing plane 3204 re- 
mote from the observer 3205, the brightness is progres- 
sively changed according to the depth position so that, 
as shown in Fig. 51B, a portion close to the observer 
3205 (a lower part of the two-dimensional image 3207) 
has a lower brightness level and a portion remote from 
the observer (an upper part of the two-dimensional im- 
age 3207) has a higher brightness level. 
[0325] Next, the brightness of the cylindrical portion 
is also changed progressively according to its depth po- 
sition so that, on an image focusing plane close to the 
observer 3205, a portion close to the observer 3205 
(around the center) has a higher brightness level and a 
portion remote from the observer (near the left and right 
end) has a lower brightness level, as shown in Fig. 51 A. 
[0326] On an image focusing plane 3204 remote from 
the observer 3205, the brightness is changed progres- 
sively so that, as shown in Fig. 51 B, a portion close to 
the observer 3205 (around the center) has a lower 
brightness level and a portion remote from the observer 
(near the left and right end) has a higher brightness lev- 
el. 

[0327] In Figs. 51 A and 51 B, the darker the image is 
shaded, the higher the brightness level it represents. 
[0328] With the above representation method, the ob- 
server 3205 perceives as if there is a cylindrical cake 
with almost flat top and bottom surfaces because of ob- 
server's physiological or mental factors or optical illusion 
although what is actually shown to the observer is two- 
dimensional images. 

[0329] With this three-dimensional display of this em- 
bodiment, it is possible to easily represent a three-di- 
mensional object having a continuous depth. 
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[D-0035] 

[Embodiment 16] 

[0330] A polarization type bifocal optical system that 
can be used in the three-dimensional displays of the pre- 
ceding embodiments will be explained. 
[0331] Fig. 52 shows examples of the polarization 
type bifocal optical system that can be used in the three- 
dimensional displays of the preceding embodiments. 
[0332] The polarization type bifocal optical systems 
represented by reference numerals 3310-3313 in Fig. 
52 each have a fixed focus lens 3301 and a birefringent 
area 3302. 

[0333] The fixed focus lens 3301 is formed by, for ex- 
ample, a convex lens of glass or plastics as shown in a 
polarization type bifocal optical system 331 3; a concave 
lens of glass or plastics as shown in a polarization type 
bifocal optical system 331 2; or a lens system combining 
convex lens, concave lens and prism of glass or plastics 
or a mirror system combining convex lens, concave tens 
and prism as shown in polarization type bifocal optical 
systems 3310, 3311, respectively. 
[0334] The birefringent area 3302 is formed of, for ex- 
ample, a medium of liquid crystals or PLZT that has bi- 
refringence. 

[D-0036] 

[0335] Here, it is assumed that the refractive index of 
the fixed focus lens 3301 is nl, that the intrinsic polari- 
zation directions in the birefringent area 3302 are p21 
and p22, and that the refractive indices in these polari- 
zation directions are n21 and n22. 
[0336] When, for example, light enters from the bire- 
fringent area 3302, the incident light is split into polar- 
ized light beams having polarization directions of p21 
and p22 according to the polarized state. The polarized 
beams propagate according to the refractive indices 
n21, n22 they sense, and contact the fixed focus lens 

3301 of the refractive index of n1. 

[0337] As shown in Fig. 53, the two polarized light 
beams, which remain split as they go out, form images 
at different positions according to the difference in the 
refractive index. That is, this optical system works as a 
bifocal optical system that splits light beam according to 
the polarization directions. 

[0338] Conversely, when lighl enters from the fixed fo- 
cus lens 3301 side, the light is split according to the re- 
fractive indices associated with the intrinsic polarization 
directions and forms images on two different image fo- 
cusing planes. 

[D-0037] 

[0339] As shown in Fig. 52, when the birefringent area 

3302 is liquid crystals, the addition of an alignment layer 

3303 can ensure uniform in-plane splitting of light enter- 



ing from the birefringent area 3302 side. 
[0340] Even when the alignment layer 3303 is provid- 
ed on only one of the birefringent areas 3302, the inci- 
dent light becomes twisted by its own optical activity ac- 

s cording to the alignment of the birefringent medium. Be- 
cause the refractive indices that the split light beams 
sense do not change, the aforementioned effect will also 
be produced without problem. 
[0341] Providing an alignment layer also on the side 

10 of an interface with the fixed focus lens 3301 is effective 
when light is thrown in from the fixed focus lens 3301 
side or when such alignment-dependent optical sys- 
tems are connected in series. 

is [D-0038] 

[0342] In the polarization type bifocal optical systems 
shown in Figs. 52 and 53, even when the fixed focus 
lens 3301 is not provided, it is obvious that if one or both 
sides of the birefringent area 3302 are formed in a lens 
or prism shape as shown in Fig. 54, the effects similar 
to those shown in Figs. 52 and 53 can be produced. 
[0343] Liquid crystal are useful as a birefringent me- 
dium because of their large refractive anisotropy. Appli- 
cable kinds of liquid crystals include ordinary nematic 
liquid crystal, polymer dispersed liquid crystal, holo- 
graphic polymer dispersed liquid crystal, polymer liquid 
crystal, smectic liquid crystal, ferroelectric liquid crystal, 
and polymer stabilized ferroelectric liquid crystal. 
[0344] Further, it is obvious that birefringence can al- 
so be obtained with polymer materials other than liquid 
crystals by aligning the major axes of the polymer ma- 
terials during forming. 

[D-0039] 

[Embodiment 17] 

[0345] Fig. 55 shows other examples of the polariza- 
tion type bifocal optical system that can be used in the 
three-dimensional displays of the preceding embodi- 
ments. 

[0346] The polarization type bifocal optical system 
shown in Fig. 55 comprises: a polarizing beam splitter 
3401 for splitting a beam on the incoming side; two op- 
tical systems 3402, 3403 with different focal lengths; a 
polarizing beam splitter 3404 for synthesizing on the 
outgoing side; and plane mirrors 3405, 3406 lor bending 
a light path. 

[0347] The two optical systems 3402, 3403 are 
formed, for example, by convex lens, concave lens, 
prism, convex/concave mirror or plane mirror or a com- 
bination of these. 

[0346] In the polarization type bifocal optical system 
shown in Fig. 55, incident light is split by the polarizing 
beam splitter 3401 into two intrinsic polarized beams 
p41 , p42 at a brightness ratio that corresponds to their 
polarization directions, and then fed into the optical sys- 
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terns 3402, 3403. 

[0349] The optical systems 3402, 3403 have different 
focal lengths and thus the incident polarized beams p41 , 
p42 have different image forming distances. 
[0350] Therefore, when both of the polarized beams s 
p41 , p42 are synthesized by the polarizing beam splitter 
3404, the two intrinsic polarized beams p41, p42 form 
images on different image focusing planes 3407, 3408. 
[0351] In this way, the optical system shown in Fig. 55 
can form a polarization type bifocal optical system that 10 
can split light at a brightness ratio that corresponds to 
the polarization directions. 

[0352] Here it is obvious that the similar effects can 
be produced it an optical system including the configu- 
ration shown in Fig. 56 is used instead of the polarizing is 
beam splitter 3401 . 

[0353] That is, the configuration of Fig. 56 includes 
polarizing plates 3411, 3412 whose polarization direc- 
tions are perpendicular to that of the beam splitter 341 0 
(e.g., semitransparenl mirror and semilransparent 20 
prism) . This configuration provides the similar effects. 
[0354] It is also possible to use an optical system hav- 
ing the configuration shown in Fig. 56 instead of the po- 
larizing beam splitter 3404. 

25 

[D-0040] 
[Embodiment 18] 

[0355] The polarization varying device that can be 30 
used in the three-dimensional displays of the preceding 
embodiments will be explained. 
[0356] A well known example of device that can 
change the polarization direction of incident light, as do 
the polarization varying devices used in the three-di- 3S 
mensional displays of the preceding embodiments, is a 
device that uses a medium (e.g., liquid crystals and 
PLZT) capable of changing birefringence by electric 
field and voltage. 

[0357] Many kinds of devices using liquid crystals are 40 
described in "Liquid Crystals, Basics" and "Liquid Crys- 
tals, Applications' (by Okano and Kobayashi, published 
by Baifukan). 

[0358] Major examples are explained below by refer- 
ring to Figs. 57 to 63A and 62B. 45 
[0359] Fig. 57 shows the outline configuration of a 
twisted nematic type polarization varying device that 
can be used in the three-dimensional displays of the pre- 
ceding embodiment. 

[0360] The twisted nematic type polarization varying so 
device shown in Fig. 57 includes a transparent conduc- 
tive layer (transparent electrode ) 3501 , an alignment 
layer 3502, a nematic liquid crystal region 3503, an 
alignment layer 3504, and a transparent conductive lay- 
er (transparent electrode )3505. 55 
[0361] It is common that the orientation directions of 
the alignment layers 3502 and 3504 are set perpendic- 
ular to each other and that a chiral material is added so 



that the liquid crystal molecules are twisted or describe 
a spiral in the same direction. 

[D-0041] 

[0362] As indicated by reference number 351 0 in Fig. 
58, when no voltage is applied between the transparent 
conductive films 3501 and 3505, the crystal molecules 
rotate 90 degrees to described a spiral by the orientation 
restriction force of the alignment layers 3502, 3504 and 
the effect of the chiral material. 
[0363] The linearly polarized incident light therefore 
has its polarization direction changed almost 90 de- 
grees by the optical activity of the liquid crystals (one of 
the properties of the birefringent material) before going 
out of the liquid crystals. 

[D-0042] 

[0364] When a voltage V5 sufficiently higher than the 
threshold voltage is applied between the transparent 
conductive films 3501 and 3505, the liquid crystal mol- 
ecules are aligned in the voltage application direction, 
as indicated by reference numeral 3511 . 
[0365] Hence, the incident light goes out almost with- 
out changing the polarization direction. 
[0366] When the voltage applied between the trans- 
parent conductive films 3501 and 3505 is V5 or lower, 
a continuous change in polarization direction according 
to the applied voltage is obtained. 
[0367] In this way, the polarization direction of the in- 
cident light can be changed by the voltage applied be* 
tween the transparent conductive films 3501 and 3505. 
[0368] Further, it is also a well known practice to ar- 
range these constitutional elements in matrix and drive 
them by using active drive elements. 

[D-0043] 

[0369] Fig. 59 shows the outline configuration of an 
in-plane type polarization varying device that can be 
used in the two-dimensional displays of the preceding 
embodiments. 

[0370] The in-plane type polarization varying device 
includes a transparent conductive film (transparent 
electrode) 3601 , an alignment layer 3602, a nematic liq- 
uid crystal region 3603, an alignment layer 3604, and a 
transparent conductive film (transparent electrode) 
3605. 

[0371] Here the orientation directions of the alignment 
layer 3602 and the alignment layer 3604 are parallel, 
and the transparent conductive films 3601 and 3605 are 
in the same plane. 

[0372] As shown by relerence numeral 3620 in Fig. 
60, when no voltage is applied between the transparent 
conductive films 3601 , 3605, the liquid crystal molecules 
are aligned in the orientation direction by the orientation 
restriction force of the alignment layers 3602, 3604. 
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[0373] When, as shown by reference numeral 3621 in 
Fig. 60, a voltage V6 sufficiently higher than the thresh- 
old voltage is applied between the transparent conduc- 
tive films 3601 and 3605, the liquid crystal molecules 
are aligned in the direction of voltage application. 
[0374] Because the direction in which the liquid crys- 
tal molecules having birefringence are aligned is 
changed in this way, the polarization state of the exit light 
can be changed. 

[0375] Further, when the voltage applied between the 
transparent conductive films 3601 and 3605 is V6 or 
lower, a continuous change in polarization direction ac- 
cording to the applied voltage is obtained. 
[0376] It is also a well known practice to arrange these 
constitutional elements in matrix and drive them by us- 
ing active drive elements. 

[0377] Fig. 61 shows the outline configuration of a ho- 
mogeneous type polarization varying device that can be 
used in the three<Jimensional displays of the preceding 
embodiments. 

[0378] The homogeneous type polarization varying 
device shown in Fig. 61 includes a transparent conduc- 
tive film (transparent electrode) 3611 , an alignment lay- 
er 3612, a liquid crystal (e.g., nematic liquid crystal) re- 
gion 3613, an alignment layer 3614, and a transparent 
conductive film (transparent electrode) 3615. 
[0379] In the homogeneous type polarization varying 
device shown in Fig. 61, because homogeneously 
aligned liquid crystals are used, the orientation direc- 
tions of the alignment layers 3612 and 3614 are set 
equal (parallel). 

[0380] Further, in the homogeneous type polarization 
varying device shown in Fig. 61, light is entered whose 
polarization direction is deviated from the orientation di- 
rection of the alignment layer. 

[0381] For example, as shown in Fig. 62A, when inci- 
dent light is linearly polarized, its polarization direction 
is shifted toward an intermediate direction between 0 
and 90° (for example 45°) when the light is thrown into 
the homogeneous type polarization varying device 
shown in Fig. 61 . 

[0382] Further, as shown in Figs. 62B and 62C, inci- 
dent light which is circularly polarized or elliptically po- 
larized is entered into the homogeneous type polariza- 
tion varying device shown in Fig. 61. 
[0383] When, as shown in Fig. 63B, a voltage V7 suf- 
ficiently higher than the threshold voltage is applied be- 
tween the transparent conductive films 3611 and 3615, 
the liquid crystal molecules are aligned in the direction 
of voltage application. 

[0384] Therefore, the incident light goes out almost 
without changing the polarization direction. 
[0385] On the other hand, when no voltage is applied 
between the transparent conductive films 3611 and 
361 5, as shown in Fig. 63A, the liquid crystal molecules 
are aligned in the orientation direction by the orientation 
restriction force of the alignment layers 3612, 3614 and 
also aligned parallel to the alignment layers 361 2, 361 4. 



[0386] Therefore, the incident light goes out with its 
polarization direction changed by the birefringence of 
the liquid crystals. 

[0387] Further, when the voltage applied between the 
5 transparent conductive layers 361 1 and 361 5 are V7 or 
lower, a continuous change in polarization direction ac- 
cording to the applied voltage is obtained. 
[0388] In this way, the polarization direction of the in- 
cident light can be changed by the voltage applied be- 
to tween the transparent conductive films 361 1 and 361 5. 
[0389] Further, it is also a well known practice to ar- 
range these constitutional elements in matrix and drive 
them by using active drive elements. 
[0390] There are apparently a variety of apparatuses 
15 that can use other liquid crystals than nematic liquid 
crystal, such as ferroelectric liquid crystal, polymer dis- 
persed liquid crystal and polymer liquid crystal, and pro- 
duce the similar effects. 

[0391] Although the present invention has been de- 
20 scribed in detail in conjunction with preceding embodi- 
ments, it should be noted that the invention is not limited 
to these embodiments and various modifications may 
be made without departing from the spirit of the inven- 
tion. 

25 

[D-0044J 

[0392] The representative advantages of this inven- 
tion may be briefly summarized as follows. 
30 [0393] Contradictions among physiological factors 
associated with stereoscopy can be minimized: the 
amount of information required can be reduced; and 
electrically rewritable three-dimensional videos can be 
reproduced. 

35 

[E-0007] 

[Embodiment 19] 

40 [0394] In the following examples, a word "plane" on 
which to put an image is used. This is similar in meaning 
to an image plane that is often used in optics. Means to 
realize such an image plane can obviously be realized 
by combining many optical devices, which include a va- 

45 riety of optical elements (e.g., lens, total reflecting mir- 
ror, partial reflecting mirror, curved mirror, prism, polar- 
izer and wavelength plate) and two-dimensional dis- 
plays (e.g., CRT, liquid crystal display, LED display, 
plasma display, FED display, DMD display, projection 

50 type display and line drawing type display). 

[0395] The following examples concern a case where 
a three-dimensional object to be presented is displayed 
as two-dimensional images on mainly two planes. If the 
number of planes is increased to more than two, the sim- 

55 jiar effect can obviously be expected. 

[0396] Fig. 64 shows the principle of a head-mounted 
display according to a nineteenth embodiment of the 
present invention. 
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[0397] In this embodiment a plurality of planes 4101, 
4102 are sat in front of an observer 41 00 (with the plane 
4101 put closer to the observer 4100 than the plane 
4102, for example). To display a plurality of two-dimen- 
sional images on these planes, an optical system 4103 
is constructed by using two-dimensional displays and a 
variety of optical elements. 

(Details will be described in the twentieth and 
subsequent embodiment.) 

[0398] Example two-dimensional displays include 
CRT, liquid crystal display, LED display, plasma display, 
FED display, DMD display projection type display and 
line drawing type display Example optical elements in- 
clude lens, total reflecting mirror, partial reflecting mirror, 
curved mirror, prism, polarizer and wavelength plate. 
[0399] The observer 4100 wears fixing means 4110 
to fix relative positions of a plurality of two-dimensional 
images displayed on the planes 4101 , 4102 with respect 
to left and right eyes of the observer 4100. 

[E-0008] 

[0400] Next, as shown in Fig. 65, a three-dimensional 
object 41 04 to be presented to the observer 41 00 is pro- 
jected onto the planes 4101, 4102 as seen from one 
point on a line connecting the left and right eyes of the 
observer 4100 to form two-dimensional images 4105, 
4106. 

[0401] The two-dimensional images can be generat- 
ed by a variety of ways, which include a technique that 
photographs the object 4104 by camera from the one 
point described above; a technique that synthesizes a 
plurality of two-dimensional images photographed from 
different directions; or synthesizing and modeling tech- 
niques based on computer graphics. 
[0402] The two-dimensional images 4105, 4106 are 
displayed on the planes 4101 , 4102 as shown in Fig. 64 
so that they overlap each other as seen from the one 
point. 

[0403] This can be achieved by putting the centers or 
gravity centers of the two-dimensional images 4105, 
4106 on the line of sight. 

[E-0009] 

[0404] The important point of this embodiment is that, 
on the apparatus having the above configuration, the 
brightness levels of the two-dimensional images are 
changed according to the depth position of the three- 
dimensional object 4104 while keeping constant the 
overall brightness as seen by the observer 4100 (i.e., in 
such a way that the overall brightness as seen by the 
observer 4100 is equal to the brightness of the three- 
dimensional object 4104). 

[0405] One example method of changing the bright- 
ness level is described below 



[0406] Figs. 66 to 69 are black and white illustrations 
and, for simplicity, parts with higher brightness levels are 
shaded darker. 

[0407] For example, when the three-dimensional ob- 
5 ject 41 04 is displayed at a depth position corresponding 
to the position of the plane 4101 , the brightness of a two- 
dimensional image 4105 on the plane 4102 is set equal 
to that of the three-dimensional object 4104 and the 
brightness of the two-dimensional image 4106 on the 
10 plane 4102 is set to zero, as shown in Fig. 66. 

[0408] Next, when the three-dimensional object 4104 
moves slightly away from the observer 4100 and is 
shown at a depth position slightly away from the plane 
41 01 and closer to the plane 41 02, the brightness of the 
75 two-dimensional image 41 05 is slightly lowered and the 
brightness of the two-dimensional image 41 06 is slightly 
raised, as shown in Fig. 67. 

[0409] Further, when the three-dimensional object 
4104 moves further away from the observer 4100 and 
20 is shown at a depth position further away from the plane 
4101 and closer to the plane 41 02, the brightness of the 
two-dimensional image 4105 is further lowered and the 
brightness of the two-dimensional image 4106 is further 
raised. 

2S [0410] Finally, when the three-dimensional object 
4104 is shown at a depth position corresponding to the 
position of the plane 4102, the brightness of the two- 
dimensional image 4106 on the plane 4102 is set equal 
to that of the three-dimensional object 4104 and the 

30 brightness of the two-dimensional image 4105 on the 
plane 4101 is set to zero as shown in Fig. 69 for in- 
stance. 

[0411] Displaying the object in this manner enables 
the observer 4100 to feel as if the three-dimensional ob- 

35 ject 4104 is located between the planes 4101 and 4102 
because of observer's physiological or mental factors or 
optical illusion although what is actually shown to the 
observer is the two-dimensional images 4105, 4106. 
[041 2] That is, when for example the two-dimensional 

40 images 41 05, 41 06 with almost equal brightness are dis- 
played on the planes 4101 and 4102, the three-dimen- 
sional object 4 104 looks as if it lies near to a middle point 
between the depth positions of the planes 4101, 4102. 

45 [E-0010] 

[0413] Particularly when a point between the left and 
right eyes is used as a viewing point on a line connecting 
the left and right eyes of the observer 41 00, the reliability 
so for producing this effect is increased (or simply put, this 
same effect can be produced for a large number of peo- 
ple or most of the time). 

[0414] Further, when a center position between the 
left and right eyes of the observer 4100 is used as the 
55 viewing point, there is an advantage that the same effect 
can be more readily produced and that the size of a dou- 
ble image produced from the planes 4101 , 4102 for both 
eyes can be reduced. 
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[E-0011] 

[0415] The above description concerns a method and 
apparatus in which the overall depth position of the 
three-dimensional object 4104 is represented by using s 
two-dimensional images on the planes 4101 and 4102. 
This embodiment apparently can be applied also as a 
method and apparatus that represents the depth of the 
three-dimensional object itself. 

[0416] In this case, the brightness level of each part 10 
of the two-dimensional images 4105, 4106 needs to be 
changed according to the depth position of each corre- 
sponding part of the three-dimensional object 4104 
while keeping constant the overall brightness as seen 
by the observer 4100 (i.e., in such a way that the overall »s 
brightness as seen by the observer 41 00 is equal to the 
brightness of the three-dimensional object 4104). 
[0417] For example, the brightness of the two-dimen- 
sional image 4105 displayed on the plane 4101 close to 
the observer 4100 is changed progressively according 20 
to the depth position of the corresponding part of the 
object so that a portion close to the observer 4100 has 
a higher brightness level and a portion remote from the 
observer has a lower brightness level. 
[0418] The brightness of the two-dimensional image 2s 
4105 displayed on the plane 4102 remote from the ob- 
server 4100 is progressively changed according to the 
depth position of the corresponding part of the object so 
that a portion close to the observer has a lower bright- 
ness level and a portion remote from the observer has 30 
a higher brightness level. 

[0419] Displaying the object in this manner enables 
the observer 4100 to feel as if the object presented has 
a solid body with some depth because of observer's 
physiological or mental factors or optical illusion al- 35 
though what is actually shown to the observer is two- 
dimensional images. 

[E-0012] 

40 

[0420] Unlike the conventional apparatus (planar dis- 
play), this embodiment has at least two image display 
planes on the near and far sides of the optical illusion 
positioa so that contradictions among the binocular par- 
allax, convergence and focusing - the problem experi- <s 
enced with the conventional apparatus - can be sup- 
pressed significantly which in turn is expected to reduce 
eyestrains. 

[0421] As to the focusing, because the observer 4100 
sees two or more planes simultaneously, the focus point so 
coincides with the optical illusion position where both of 
the images can be seen with minimum blur. 
[0422] Further, because this embodiment can also 
present a three-dimensional object 4104 that exists be- 
tween a plurality of planes, there is an advantage that ss 
the amount of data required for three-dimensional rep- 
resentation can be reduced substantially. 
[0423] Further, because the apparatus of this embod- 



iment is fixedly worn by the observer 4100, this embod- 
iment has the advantage of being able to easily display 
two-dimensional images according to the movement of 
the observer 4100 or eyes. 

[0424] Although the head-mounted display is basical- 
ly a display that is secured to the head of the wearer, 
the present invention can apparently be applied also to 
an apparatus that is not mounted on the head as long 
as the apparatus is so constructed that the positional 
relationship between the eyes of the observer and the 
plane will not be changed. 

[0425] Further, because this embodiment makes use 
of human physiological or mental factors or optical illu- 
sion based only on brightness changes of two-dimen- 
sional images, the embodiment does not require the use 
of a coherent light source such as a laser and facilitates 
the color stereoscopic image representation. 
[0426] Further, since this embodiment does not in- 
clude mechanical driving parts, it can suitably reduce 
the weight of and improve the reliability of the apparatus. 
[0427] This embodiment mainly concerns a case 
where there are only two planes for displaying two-di- 
mensional images and where a three-dimensional ob- 
ject to be presented to the observer 4100 lies between 
the two planes. It is, however, apparent that tho similar 
configuration can be employed if there are more planes 
or the three-dimensional object 41 04 to be presented is 
located at a different position. 

[E-0013] 

[0428] This embodiment can obviously display a vid- 
eo so that an observer can see the motion of an object 
in the horizontal and vertical directions as long as the 
two-dimensional displays have display speeds compat- 
ible with the video. It is also apparent that the motion of 
an object in the depth direction can also be presented 
to the observer by changing the brightness of a plurality 
of planes for each frame. 

[0429] In this case, the brightness of each part of the 
two-dimensional images 41 05, 4106 is changed accord- 
ing to a change over time of the depth position of the 
three-dimensional object 4104 while keeping constant 
the overall brightness as seen by the observer 4100 (i. 
e., in such a way that the overall brightness as seen by 
the observer 41 00 is equal to the brightness of the three- 
dimensional object 4104). 

[0430] That is, when for example the three-dimen- 
sional object 4104 is on the plane 4101, the brightness 
of the two-dimensional image 4105 on the plane 4101 
is set equal to that of the three-dimensional object 4104 
and the brightness of the two-dimensional image 4106 
on the plane 4102 is set to zero. 

(E-0014) 

[0431] Next, when the three-dimensional object 4104 
progressively moves slightly away from the observer 
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4100 and inches from the plane 4101 toward the plane 
4102 over time, the brightness of the two-dimensional 
image 4105 is towered slightly over time according to 
the movement in the depth positbn of the three-dimen- 
sional object 4104 and at the same time the brightness 
of the two-dimensional image 4106 is slightly raised 
over time. 

[0432] Next, when the three-dimensional object 4104 
moves further away from the observer 41 00 and inches 
from the plane 4101 further toward the plane 4102 over 
time, the brightness of the two-dimensional image 4105 
is lowered further over time according to the movement 
in the depth position of the three-dimensional object 
4104 and at the same time the brightness of the two- 
dimensional image 4105 is raised further over time. 
[0433] Next, when the three-dimensional object 41 04 
finally reaches the plane 4102 over time, the brightness 
of the two-dimensional image 4106 on the plane 4102 
is changed over time until it becomes equal to the bright- 
ness of the three-dimensional object 4104 according to 
the movement in the depth positbn of the three-dimen- 
sional object 4104 and at the same time the brightness 
of the two-dimensional image 4105 on the plane 4101 
is changed over time until it becomes zero. 
[0434] Displaying the object in this way enables the 
observer 4100 to feel as if the three-dimensional object 
4104 moves over time from the plane 4101 to the plane 

4102 in the direction of depth because of observer's 
physiological or mental factors or optical illusion al- 
though what is actually shown to the observer is two- 
dimensional images 4105, 4106. 

[0435] It is obvious that, because of the after image 
effect, the above-described effect of this embodiment 
can be produced as long as the two-dimensional images 
are displayed within one frame, whether they are dis- 
played simultaneously or at different times, or displayed 
simultaneously for one duration and separately for an- 
other duration. 

[0436] Further, this embodiment has an advantage of 
being able to significantly reduce the amount of data re- 
quired for three-dimensional representation because 
this embodiment can display a stereoscopic represen- 
tation of a three-dimensional object lying between a plu- 
rality of planes. 

[Embodiment 20] 

[0437] Fig. 70 illustrates the principle of a head- 
mounted display according to a twentieth embodiment 
of the invention. 

[0438] In this embodiment, a plurality of planes, for 
example, planes 1R1, 1R2, 1L1, 1L2 are arranged in 
front of the left and right eyes of the observer 4100 (the 
planes 1R1, 1L1 are set closer to the observer 4 100 than 
the planes 1R2, 1L2). To display a plurality of two-di- 
mensional images on these planes, an optical system 

4103 is constructed for each of the left and right eyes 
by using two-dimensional displays and a variety of op- 



tical elements. (Details will be described in the twenty- 
first and subsequent embodiments.) 
[0439] Examples of the two-dimensional displays in- 
clude CRT, liquid crystal display, LED display, plasma 

5 display, FED display, projection type display and line 
drawing type display. Examples of optical elements in- 
clude lens, total reflecting mirror, partial reflecting mirror, 
curved mirror, prism, polarizer and wavelength plate. 
[0440] The observer 41 00 wears a fixing means 41 1 0 

10 to fix the relative positions between the plurality of two- 
dimensional images displayed on these planes 1R1, 
1 R2, 1 L 1 , 1 12 and the left and right eyes of the observer 
4100. 

15 [E-0015] 

[0441] Next, as shown in Fig. 71 , a three-dimensional 
object 41 04 to be presented to the observer 41 00 is pro- 
jected onto the planes 1R1, 1R2, 1L1, 1L2, as viewed 
20 from one point on a line connecting the left and right 
eyes of the observer 4100, to form two-dimensional im- 
ages 1R5, 1R6, 1L5, 1L6. 

[0442] While Fig. 71 shows the configuration for only 
the right eye, the configuratbn for the left eye can be 

25 obtained simply by replacing the symbol R with L. 

[0443] The two-dimensbnal images 1 R5, 1 R6, 1 L5, 
1L6 can be generated by a variety of ways, which in- 
clude a technique that uses two-dimensional images ob- 
tained by photographing the three-dimensional object 

30 4104 by camera in the direction of line ol sight; a tech- 
nique that synthesizes a plurality of two-dimensional im- 
ages photographed from different directions; or synthe- 
sizing and modeling techniques based on computer 
graphics. 

35 [0444] The two-dimensional images 1R5, 1R6, 1L5, 
1L6, as shown in Fig. 70, are displayed on the planes 
1 R1 , 1 L1 and planes 1 R2, 2L2 so that they overlap each 
other as seen from one point on the line connecting the 
left and right eyes of the observer 4100. 

40 [0445] This can be achieved by putting the centers or 
gravity centers of the two-dimensional images 1R5, 
1 R6, 1 L5, 1 L6 on the line of sight. 

[E-0016] 

45 

[0446] The important point of this embodiment is that, 
in the apparatus having the above-described configura- 
tion, the brightness of each of Ihe two-dimensional im- 
ages 1 R5, 1 R6, 1 L5, 1 L6 is changed within the after im- 

so age time of the human eye according to the depth posi- 
tion of the three-dimensional object 4104 (see Fig. 65) 
while keeping constant the overall brightness as seen 
by the observer 4100 (i.e., in such a way that the overall 
brightness as seen by the observer 4100 is equal to the 

55 brightness of the three-dimensional object 41 04. 

[0447] One example method of changing the bright- 
ness is described be tow. 

[0448] Figs. 72 to 75 show the configuratbn for only 
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the right eye because the same configuration applies 
also to the left eye. Because Figs. 72 to 75 are black 
and white illustrations, parts with higher brightness lev- 
els are shaded darker for simplicity. 
[0449] When, for example, the three-dimensional ob- s 
ject 41 04 is displayed at a depth position corresponding 
to the positions of the planes 1R1, 1L1, the brightness 
levels of the two-dimensional images 1R5, 1L5 on the 
planes 1 R1 , 1 L1 are set equal to the brightness level of 
the three-dimensional object 4104 and the brightness io 
levels of the two-dimensional images 1R6, 1L6 on the 
planes 1 R2, 1 L2 are set to zero, as shown in Fig. 72. 
[0450] Next, when the three-dimensional object 41 04 
moves slightly away from the observer 4100 and is dis- 
played at a depth position slightly away from the planes is 
1 R1 , 1 L1 and closer to the planes 1 R2, 1 L2, the bright- 
ness levels of the two-dimensional images 1 R5, 1 L5are 
slightly lowered and the brightness levels of the two-di- 
mensional images 1R6, 1L6 are slightly raised, as 
shown in Fig. 73. 20 
[0451] Next, when the three-dimensional object 41 04 
moves further away from the observer 4100 and is dis- 
played at a depth position further away from the planes 
1R1, 1L1 and closer to the planes 1R2, 1 L2, the bright- 
ness levels of the two-dimensional imagos 1 R5, 1 L5 are 2s 
further lowered and the brightness levels of the two-di- 
mensional images 1R6 t 1L6 are further raised, as 
shown in Fig. 74. 

[0452] Finally, when the three-dimensional object 
4104 is displayed at a depth position corresponding to 30 
the planes 1R2, 1L2, the brightness levels of the two- 
dimensional images 1R6, 1L6 on the planes 1R2, 1L2 
are set equal to the brightness level of the three-dimen- 
sional object 4104 and the brightness levels of the two- 
dimensional images 1R5, 1L5 on the planes 1R1, 1L1 35 
are set to zero, as shown in Fig. 75. 
[0453] Displaying the object in this manner enables 
the observer 41 00 to feel as if the three-dimensional ob- 
ject 4104 is located between the planes 1R1, 1L1 and 
the planes 1 R2, 1 L2 because of human physiological or 40 
mental factors or optical illusion although what is actu- 
ally shown to the observer is the two-dimensional imag- 
es 1R5, 1R6, 1L5, 1L6. 

[0454] That is, when for example the two-dimensional 
images with almost equal brightness are displayed on 45 
the planes 1 R1 , 1 LI and the planes 1 R2, 1 L2, the three- 
dimensional object 4104 looks as if it lies near to a mid- 
dle point between the depth positions of the planes 1R1 , 
1L1 and the planes 1R2, 1L2. 

[0455] Particularly when a point between the left and so 
right eyes is used as a viewing point on a line connecting 
the left and right eyes of the observer 4100 : the reliability 
for producing this effect is increased (or simply put, this 
same effect can be produced for a large number of peo- 
ple or most of the time). 55 
[0456] Further, when a center position between the 
left and right eyes of the observer 4100 is used as the 
viewing point, there is an advantage that the same effect 
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can be more readily produced and that the size of double 
image produced from the planes 1R1, 1 LI and planes 
1 R2, 1 R2 for both eyes can be reduced. 

[E-0017] 

[0457] As with the nineteenth embodiment, this em- 
bodiment can obviously express the depth of a three- 
dimensional object itself. 

[0458] Unlike the conventional apparatus, this em- 
bodiment has at least two image display planes on the 
near and far sides of the optical illusion position, so that 
contradictions among the binocular parallax, conver- 
gence and focusing - the problem experienced with the 
conventional apparatus - can be suppressed signifi- 
cantly, which in turn is expected to reduce eyestrains. 
[0459] As to the focusing, because the observer 41 00 
sees two or more planes simultaneously, the focus point 
coincides with the optical illusion positbn where both of 
the images can be seen with minimum blur. 
[0460] In this embodiment, because the displays are 
mounted one for each eye, there is an advantage that 
the two-dimensional images can be readily displayed 
according to the movement of the observer or eyes. 
[0461] Further, because this embodiment makes use 
of human physiological or mental factors or optical illu- 
sion based only on brightness changes of two-dimen- 
sional images, the embodiment does not require the use 
of a coherent light source such as a laser and facilitates 
the color stereoscopic image representation. 
[0462] Further, since this embodiment does not in- 
clude mechanical driving parts, it can suitably reduce 
the weight of and improve the reliability of the apparatus. 
[0463] This embodiment mainly concerns a case 
where there are only two planes for displaying two-di- 
mensional images and where a three-dimensional ob- 
ject 4104 to be presented to the observer 4100 lies be- 
tween the two planes. It is, however, apparent that the 
similar configuration can be employed if there are more 
planes or the three-dimensional object 4104 to be pre- 
sented is located at a different position. 
[0464] Like the nineteenth embodiment, this embodi- 
ment can obviously display a video so that an observer 
can see the motion of an object in the horizontal and 
vertical directions as long as the two-dimensional dis- 
plays have display speeds compatible with the video. It 
is also apparent that the motion of an object in the depth 
direction can also be presented to the observer by 
changing the brightness of a plurality of planes for each 
frame. 

[0465] It is obvious that, because of the after image 
effect, the above-described effect of this embodiment 
can be produced as long as the two-dimensional images 
are displayed within one frame, whether they are dis- 
played simultaneously or at different times, or displayed 
simultaneously for one duration and separately for an- 
other duration. 

[0466] Further, this embodiment has an advantage of 



EP 0 959 377 A2 



31 



BNSDOCID: <EP opr.Q377A? i > 



61 



EP 0 959 377 A2 



62 



being able to significantly reduce the amount of data re- 
quired for three-dimensional representation because 
this embodiment can display a stereoscopic represen- 
tation of a three-dimensional object lying between a plu- 
rality of planes. 

[Embodiment 21] 

[0467] An optical system 41 03 that can be used in the 
preceding embodiments will be described. 
[0468] Fig. 76 shows one example of the optical sys- 
tem 4103 that can be used in the preceding embodi- 
ments of the present invention. 
[0469] The optical system 41 03 shown in Fig. 76 em- 
ploys a plurality of two-dimensional displays 4201, 
4202, a total reflecting mirror 4203 (for example, reflec- 
tivity/transmittivity = 100/0), and a partial reflecting mir- 
ror 4204 (for example, reflectivityAransmittivity = 50/50). 
[0470] The plurality of two<limensional displays 
4201 , 4202 are, for example, CRT, liquid crystal display, 
LED display, plasma display, FED display, DMD display, 
projection type display and line drawing type display. 
[0471] In the optical system shown in Fig. 76, by 
changing the arrangement of the constitutional ele- 
ments, it is possible to place two planes 4205, 4206 at 
different positions in the direction of depth, the plane 
4205 being formed by reflecting a two-dimensional im- 
age of the two-dimensional display 4201 by the total re- 
flecting mirror 4203 and passing it through the partial 
reflecting mirror 4204, the plane 4206 being formed by 
reflecting a two-dimensional image of the two-dimen- 
sional display 4202 by the partial reflecting mirror 4204. 
[0472] In the optical system shown in Fig. 76, only mir- 
rors (total reflecting mirror 4203 and partial reflecting 
mirror 4204) are used, there is an advantage of less deg- 
radation of image quality. 

[E-0018] 

[0473] Fig. 77 illustrates another example of optical 
system 4103 that can be used in the preceding embod- 
iments of the invention. 

[0474] The optical system 41 03 shown in Fig. 77, by 
including lenses 4207, 4208 in the optical system shown 
in Fig. 76, makes it possible to change the position of 
the planes more flexibly. 

[0475] In the optical system shown in Fig. 77, which 
includes a plurality of two-dimensional displays 4201, 
4202, a total reflecting mirror 4203 (for example, reflec- 
tivity/transmittivity = 100/0), and a partial reflecting mir- 
ror 4204 (for example, reflectivity/transmittivity - 50/50), 
convex lenses 4207, 4208 are added to change the po- 
sitions of the images, thus allowing more flexible setting 
of the positional relation between the plane 4205 and 
the plane 4206 which has been restricted by the size of 
the apparatus. 

[0476] As in the ordinary lens system, it may of course 
be advantageous in terms of distortion to use a combi- 



nation lens in addition to convex lenses. 
[0477] Further, although this embodiment has shown 
a case where virtual images are used, it is obvious that 
the invention can also be applied to a case where real 
5 images are used. 

[E-0019] 

[0478] Fig. 78 shows a further example of optical sys- 
10 tern 4103 that can be used in the preceding embodi- 
ments of the invention. 

[0479] The optical system 4103 shown in Fig. 78 in- 
corporates additional two-dimensional displays into the 
optical system shown in Fig. 76. 
[0480] That is, a plurality of two-dimensional displays 
4211, 4212, 4213, 4214, 4215, a total reflecting mirror 
4216 (e.g., reflectivity/transmittivity = 100/0) and partial 
reflecting mirrors 4217 (e.g., reflectivity/transmittivity = 
50/50), 4218 (e.g. , reflectivity/transmittivity = 33.3/66.7), 
421 9 (e.g., refleclivily/lransmittivity = 25/75), 4220 (e.g., 
reflectivityAransmittivity = 20/80) are used to construct 
an optical system. 

[0481] In the optical system 41 03 shown in Fig. 78, by 
changing the arrangements of these constitutional com- 
ponents, it is possible to place a plane 4221 and planes 
4222-4225 at different positions in the direction of depth, 
the image plane 4221 being formed by reflecting a two- 
dimensional image of the two-dimensional display 4211 
by the total reflecting mirror 4216 and passing it through 
the partial reflecting mirrors 4217-4220, the planes 
4222-4225 being formed by reflecting two-dimensional 
images of the two-dimensional displays 4212-4215 by 
the partial reflecting mirrors 4217-4220 and passing 
them through these partial reflecting mirrors. 
[0482] This optical system 41 03 shown in Fig. 78 uses 
only mirrors and thus has the advantage of less degra- 
dation of picture quality. 

[0483] While Fig. 78 shows a case where there are 
five two-dimensional displays, it is apparent that the sim- 
ilar configuration can be adopted when a different 
number of two-dimensional displays are used. 
[0484] In this case also, it is obvious that adding lens 
systems as shown in Figs. 77 makes it easy to control 
the positions of planes. 

[E-0020] 

[0485] Fig. 79 shows a further example of the optical 
system 4103 that can be used in the preceding embod- 
iments of the invention. 

[0486] The optical system 4 103 shown in Fig. 79 uses 
a plurality of projector type two-dimensional displays 
4231, 4232, 4233, 4234, 4235, shutters 4241, 4242, 
4243, 4244, 4245, and scatter plates 4236, 4237, 4238, 
4239, 4240 to project two-dimensional images from the 
projector type two-dimensional displays 4231-4235 
through the shutters 4236-440 onto the scatter plates 
4236-4240 to produce the two-dimensional images at 
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desired locations. 

[0487] The projector type two-dimensional displays 
4231 -4235 are, for example, of CTRtype, LCD type, ILV 
type, DMD type, etc. 

[0488] The scatter plates 4236-4240 are, for example, 
such devices as can control scattering/transmission or 
reflection/transmission, such as polymer dispersed liq- 
uid crystal devices, holographic polymer dispersed liq- 
uid crystal devices or combined devices of liquid crystal 
and multi-lens array. Shutters 4241-4245 may be such 
devices as can control transmission/interruption, such 
as twisted nematic liquid crystal devices, ferroelectric 
liquid crystal devices or mechanical shutter devices. 
[0489] The scatter plates 4236-4240 are arranged at 
different depth positions, the focusing planes of the pro- 
jector type two-dimensional displays 4231-4235 are 
aligned with these scatter plates 4236-4240, two-dimen- 
sional images are projected onto the scatter plates, and 
the scattering/transmission timing of the scatter plates 
4236-4240 is synchronized with the transmission/inter- 
ruption timing of the shutters 4241 -4245 when activating 
the scatter plates and the shutters. This enables the 
depth positions of the planes 4241 -4245 formed on the 
scatter plates 4236-4240 to be controlled on a time di- 
vision basis. 

[0490] Like the optical system 4103 shown in Fig. 79, 
the use of projector type two-dimensional displays 
4231-4235 provides an advantage of enhanced level of 
freedom of display layout. 

[049*1] Although the optical system 4103 of Fig. 79 
concerns a case where there are five projector type two- 
dimensional displays, it is apparent that the similar con- 
figuration can be employed when a diflerent number of 
displays are provided. 

[0492] It is obvious that the lamps of projector type 
two-dimensional displays 4231-4235 can be turned on 
or off instead of using the shutters. 

[E-0021] 

[0493] In the preceding embodiments, we have main- 
ly described a case where the planes are located near, 
inside or beyond the head-mounted displays. Incorpo- 
ration of optical devices enables these planes to be eas- 
ily arranged away from or in front of the two-dimensional 
displays. 

[0494] One such example is shown in Fig. 80. 
[0495] For example, it can easily be seen that by ar- 
ranging a lens system 4303 in front of the optical system 
4301 shown in the preceding embodiments, the internal 
planes 4302 can be moved to the positions of external 
planes 4304. 

[0496] This offers the advantage that because the 
three-dimensional images are reproduced floating in 
space, the three-dimensional images are more likely to 
appear three-dimensional to the observer than when the 
three-dimensional images are located inside or behind 
the display. 



[0497] The invention has been described in detail in 
conjunction with the preceding embodiments and it 
should be noted that the invention is not limited to these 
embodiments and that various modifications may be 
5 made without departing from the spirit of the invention. 

[E-0022] 

[0498] The representative advantages of this inven- 
10 tion may be briefly summarized as follows. 

[0499] Contradictions among physiological factors 
associated with stereoscopy can be minimized; the 
amount of information required can be reduced; and 
electrically rewritable three-dimensional videos can be 
'5 reproduced. 

[F-0001] 

[Embodiment 22] 

[0500] Figs. 81 A and 81 B show the concept of a twen- 
ty-second embodiment of the invention. 
[0501] Fig. 81 A illustrates a three-dimensional display 
5101 which allows a plurality of observers 5102, 5103, 
51 04 to simultaneously view a three-dimensional image 
displayed on the three-dimensional display 5101, by 
putting reflectors 5105, 5106, 5107 at different angles 
on the optical axis of the three-dimensional display to 
reflect the three-dimensional image toward the observ- 
ers. The reflectors 5105, 5106, 5107 used are, for ex- 
ample, half mirrors or prisms, which can perform reflec- 
tion or refraction and transmission at the same time. The 
reflector 5107 alone may use a total reflecting mirror. 
[0502] Fig. 81 B illustrates a three-dimensional display 
5111 which allows a plurality of observers 5112, 5113, 
51 1 4 to simultaneously view a three-dimensional image 
displayed on the three-dimensional display 5111, by 
putting reflectors 5115, 5116, 5117 at different angles 
on the optical axis of the three-dimensional display to 
reflect Ihe three-dimensional image toward the observ- 
ers. Optical systems 5118, 51 19, 5120 arranged on op- 
tical axes connecting the observers and the reflectors 
cause the three-dimensional image displayed on the 
three-dimensional display 5111 to be focused on an im- 
age plane 5121 so that all the observers can view the 
three-dimensional image at the same position (image 
plane 5121). The reflectors 5115, 5116, 5117 used are, 
for example, half mirrors or prisms, which can perform 
reflection or refraction and transmission at the same 
time. The reflector 5117 alone may use a total reflecting 
mirror. 

[0503] With this simple method, a three-dimensional 
display that allows a plurality of observers to view an 
image simultaneously can be realized. 

[Embodiment 23] 

[0504] Figs. 82A and 82B illustrate the concept of a 
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twenty-third embodiment of the invention. 
[0505] Fig. 82A illustrates a three-dimensional dis- 
play, which displays a three-dimensional image by using 
two displays 5201 and 5202 and which includes reflec- 
tors 5206, 5207, 5208 and reflectors 5209. 5210, 5211 
arranged at different angles on two optical axes of the 
two displays to reflect two images of the two displays 
along the same optical axis toward each of a plurality of 
observers 5203, 5204, 5205 so that each observer can 
view the two images overlapping each other and all the 
observers can view the same overlapping images at the 
same time. The reflectors 5206, 5207, 5208, 5209, 
5210, 5211 are, for example, half mirrors or prisms, 
which can perform reflection or refraction and transmis- 
sion at the same time. The reflector 5208 alone may use 
a total reflecting mirror. 

[0506] Fig. 82B illustrates a three-dimensional dis- 
play, which displays a three-dimensional image by using 
two displays 5221 and 5222 and which includes reflec- 
tors 5226, 5227, 5228 and reflectors 5229. 5230, 5231 
arranged at different angles on two optical axes of the 
two displays to reflect two images of the two displays 
along the same optical axis toward each of a plurality of 
observers 5223, 5224, 5225 so that each observer can 
view the two images overlapping each other and all the 
observers can view the same overlapping images at the 
same time. Optical systems 5232, 5233, 5234 arranged 
on optical axes connecting the observers and the reflec- 
tors cause a three-dimensional image displayed by the 
two displays 5221, 5222 to be focused on an image 
plane 5235 so that all the observers can view the three- 
dimensional image at the same position (image plane 
5235). The reflectors 5226, 5227, 5228, 5229, 5230, 
5231 are, for example, half mirrors or prisms, which can 
perform reflection or refraction and transmission at the 
same time. The reflector 5228 alone may use a total re- 
flecting mirror. 

[0507] With this simple method, a three-dimensional 
display that allows a plurality of observers to view an 
image simultaneously can be realized. 

[Embodiment 24] 

[0508] Figs. 83A and 83B illustrate the concept of a 
twenty-fourth embodiment of the invention. 
[0509] Fig. 83A shows a three-dimensional display 
5301, which includes reflectors 5305, 5306, 5307 ar- 
ranged at different angles on an optical axis of the three- 
dimensional display to reflect a three-dimensional im- 
age toward each of a plurality of observers 5302, 5303, 
5304 so that all the observers can view the three-dimen- 
sional image simultaneously. The reflectors 5305, 5306, 
5307 may use, for example, dichroic mirror, dichroic 
prism and holographic optical element, which can limit 
the wavelength to be reflected and can perform reflec- 
tion and transmission at the same time. The reflector 
5307 alone can use a total reflecting mirror. By shifting 
the reflection wavelength of each reflector to a degree 



that will not result in a significant change in color, all the 
observers can view almost the same three-dimensional 
image. Color representation can be provided by stack- 
ing reflectors of three primary colors (R, G, B) (for ex- 
5 ample, stacking three red, green and blue reflectors at 
the position of reflector 5305). 
[0510] Fig. 83B illustrates a three-dimensional dis- 
play, which displays a three-dimensional image by using 
two displays 5311 and 5312 and which includes reflec- 
10 tors 5316, 5317, 5318 and reflectors 5319, 5320, 5321 
arranged at different angles on two optical axes of the 
two displays to reflect two images of the two displays 
along the same optical axis toward each of a plurality of 
observers 5313, 5314, 5315 so that each observer can 
is view the two images overlapping each other and all the 
observers can view a three-dimensional image at the 
same time. The reflectors 5316, 5317, 5318, 5319, 
5320, 5321 may use, for example, dichroic mirror, dich- 
roic prism and holographic optical element, which can 
limit the wavelength to be reflected and can perform re- 
flection and transmission at the same time. The reflector 
5318 alone can use a total reflecting mirror. By shifting 
the reflection wavelength of each reflector to a degree 
that will not result in a significant change in color, all the 
observers can view almost the same three-dimensional 
image. Color representation can be provided by stack- 
ing reflectors of three primary colors (R, G, B) (for ex- 
ample, stacking three red, green and blue reflectors at 
the position of reflector 5316). The paired reflectors (e. 
g., reflector 5316 and reflector 5319) may have the 
same band of wavelength. 

[0511] This configuration is possible even when mir- 
rors are overlapping each other on an optical axis. 



[0512] Fig. 84A and 84B show the concept of a twen- 
ty-fifth embodiment of the invention. 
[0513] Fig. 84A shows a three-dimensional display, 

40 which includes a viewing zone distributor 5407 to dis- 
tribute an optical axis from the three-dimensional dis- 
play 5401 into a plurality of optical axes and refract light 
from the three-dimensional display toward each of a plu- 
rality of observers 5402. 5403, 5404, 5405, 5406 so that 

45 all the observers can simultaneously view the same 
three-dimensional image displayed on the three-dimen- 
sional display. Among example devices used for the 
viewing zone distributor 5407 are a holographic optical 
element that has a plurality of diffraction angles and can 

so diffract rays of light at different angles at the same time, 
a prism array 5421 such as shown in Fig. 84C, and a 
diffraction grating array 5441 such as shown in Fig. 84E. 
The prism array 5421 has a number of small prisms 
5422 with different refraction directions to refract and 

55 distribute light from the three-dimensional display to- 
ward each of the observers. Likewise, the diffraction 
grating array 5441 has a number of small diffraction 
gratings 5442 with different sizes of gratings to diffract 
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and distribute light from the three-dimensional display 
toward each of the observer. 

[0514] Fig. 84B shows a three-dimensional display, 
which includes a viewing zone distributor 5417 to dis- 
tribute an optical axis from the three-dimensional dis- 
play 5411 into a plurality of optical axes and reflect light 
from the three-dimensional display toward each of a plu- 
rality of observers 541 2, 541 3, 541 4, 541 5, 541 6 so that 
all the observers can simultaneously view the same 
three-dimensional image displayed on the three-dimen- 
sional display. Among example devices used for the 
viewing zone distributor 5417 are a holographic optical 
element that has a plurality of reflection angles and can 
reflect rays of light at different angles at the same time, 
a mirror array 5431 such as shown in Fig. 84D, and a 
diffraction grating array 5441 such as shown in Fig. 84E. 
The mirror array 5431 has a number of small mirrors 
5432 with different reflection directions to reflect light 
from the three-dimensional display toward each of the 
observers. Likewise, the diffraction graling array 5441 
has a number of small diffraction gratings 5442 with dif- 
ferent sizes of gratings to reflect and distribute light from 
the three-dimensional display toward each of the ob- 
server. 

[0515] This arrangement can expand a viewing zone 
of an observer while moving or a viewing zone for a plu- 
rality of observers. 

[Embodiment 26] 

[051 6] Figs. 85A and 85B show the concept of a twen- 
ty-sixth embodiment of the invention. 
[0517] Fig. 85A shows a three-dimensional display, 
which includes a viewing zone distributor 5507 to dis- 
tribute an optical axis from the three-dimensional dis- 
play 5501 into a plurality of optical axes and refract light 
from the three-dimensional display toward each of a plu- 
rality of observers 5502. 5503. 5504. 5505, 5506 so that 
all the observers can simultaneously view the same 
three-dimensional image displayed on the three-dimen- 
sional display. The viewing zone distributor 5507 uses 
a plurality of holographic optical elements stacked to- 
gether each of which can diffract light at only one angle. 
The holographic optical elements 5508, 5509, 5510, 
5511. 5512 with different diffraction angles are stacked 
together to diffract light from the three-dimensional dis- 
play toward the respective observers. 
[0518] Fig. 85B shows a three-dimensional display, 
which includes a viewing zone distributor 5527 to dis- 
tribute an optical axis from the three-dimensional dis- 
play 5521 into a plurality of optical axes and reflect light 
from the three-dimensional display toward each of a plu- 
rality of observers 5522. 5523, 5524, 5525, 5526 so that 
all the observers can simultaneously view the same 
three-dimensional image displayed on the three-dimen- 
sional display. The viewing zone distributor 5527 uses 
a plurality of holographic optical elements stacked to- 
gether each of which can diffract light at only one angle. 



The holographic optical, elements 5528. 5529, 5530, 
5531, 5532 with different reflection angles are stacked 
together to distribute light from the three-dimensional 
display toward the respective observers. 
s [0519] This arrangement can expand a viewing zone 
of an observer while moving or a viewing zone for a plu- 
rality of observers. 

[Embodiment 27] 

10 

[0520] Figs. 86A to 86D show the concept of a twenty- 
seventh embodiment of the invention. 
[0521] Fig. 86A illustrates a three-dimensional dis- 
play, which includes a viewing zone distributor 5607 to 
is distribute an optical axis from the three-dimensional dis- 
play 5601 into a plurality of optical axes on a time divi- 
sion basis and refract light from the three-dimensional 
display toward each of a plurality of observers 5602, 
5603, 5604, 5605, 5606 so that all the observers can 
view the same three-dimensional image. The viewing 
zone distributor 5607 uses a liquid crystal deflection el- 
ement which comprises a liquid crystal and an optical 
element disposed in contact with the liquid crystal. The 
liquid crystal deflection element deflects light from the 
three-dimensional display at high speed within the after 
image time of human eye between observer 5602 and 
observer 5606 to distribute light to individual observers. 
When the light, while being deflected, reaches the di- 
rection of an observer, it is halted temporarily at that po- 
sition and then deflected toward the next observer. This 
process is repeated at high speed allowing the observ- 
ers to see a three-dimensional image. 
[0522] Fig. 86B illustrates a three-dimensional dis- 
play, which includes a viewing zone distributor 561 7 and 
a reflector 5618 to distribute an optical axis from the 
three-dimensional display 5611 into a plurality of optical 
axes on a time division basis and reflect light from the 
three-dimensional display toward each of a plurality of 
observers 5612, 5613, 5614, 561 5 : 5616 so that all the 
observers can view the same three-dimensional image. 
The viewing zone distributor 5617 uses a liquid crystal 
deflection element which comprises a liquid crystal and 
an optical element disposed in contact with the liquid 
crystal. The liquid crystal deflection element deflects 
light from the three-dimensional display at high speed 
within the after image time of human eye between ob- 
server 5612 and observer 5616 to distribute light to in- 
dividual observers. When the light, while being deflect- 
ed, reaches the direction of an observer, it is halted tem- 
porarily at that position and then deflected toward the 
next observer. This process is repeated at high speed 
allowing the observers to see a three-dimensional im- 
age. The reflector 5618 uses such reflecting material as 
mirror. 

[0523] Fig. 86C illustrates a three-dimensional dis- 
play, which includes a viewing zone distributor 5627 to 
distribute an optical axis from the three-dimensional dis- 
play 5621 into a plurality of optical axes on a time divi- 
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sion basis and refract light from the three-dimensional 
display toward each of a plurality of observers 5622, 
5623. 5624, 5625, 5626 so that all the observers can 
view the same three-dimensional image. The viewing 
zone distributor 5627 uses a liquid crystal deflection el- 
ement which comprises a liquid crystal and an optical 
element disposed in contact with the liquid crystal. The 
liquid crystal deflection element deflects light from the 
three-dimensional display at high speed within the after 
image time of human eye between observer 5622 and 
observer 5626 to distribute light to individual observers. 
A shutter 5628 is operated at the same time that the re- 
fraction direction of the viewing zone distributor 5627 
aligns with the direction of each observer, thus allowing 
the observers to see a three-dimensional image. 
[0524] Fig. 86D illustrates a three-dimensional dis- 
play, which includes a viewing zone distributor 5637 and 
a reflector 5638 to distribute an optical axis from the 
three-dimensional display 5631 into a plurality of optical 
axes on a lime division basis and reflect light from the 
three-dimensional display toward each of a plurality of 
observers 5632, 5633, 5634, 5635, 5636 so that all the 
observers can view the same three-dimensional image. 
The viewing zone distributor 5637 uses a liquid crystal 
deflection element which comprises a liquid crystal and 
an optical element disposed in contact with the liquid 
crystal. The liquid crystal deflection element deflects 
light from the three-dimensional display at high speed 
within the after image time of human eye between ob- 
server 5632 and observer 5636 to distribute light to in- 
dividual observers. A shutter 5639 is operated at the 
same time that the refraction direction of the viewing 
zone distributor 5637 aligns with the direction of each 
observer, thus allowing the observers to see a three-di- 
mensional image. The reflector 5638 uses such reflect- 
ing material as mirror. 

[0525] This apparatus can also be used for expanding 
a viewing zone of an observer when he or she moves. 

[Embodiment 28] 

[0526] Figs. 87A and 87B show the concept of a twen- 
ty-eighth embodiment of the invention. 
[0527] Fig. 87A illustrates a three-dimensional dis- 
play, which includes a reflector 5707 to distribute an op- 
tical axis from the three-dimensional display 5701 into 
a plurality of optical axes on a time division basis and 
reflect/refract light from the three-dimensional display 
toward each of a plurality of observers 5702, 5703, 
5704, 5705, 5706 so that all the observers can view the 
same three-dimensional image. Among devices used 
for the reflector 5707 are a half mirror, a total reflecting 
mirror and a prism. The reflector 5707 deflects light from 
the three-dimensional display at high speed within the 
after image time of human eye between observer 5702 
and observer 5706 to distribute light to individual ob- 
servers. Light distribution can be achieved by recipro- 
cating Ihe reflector to left and right at high speed or by 



rotating it in one direction. When the light, while being 
deflected, reaches the direction of an observer, it is 
stopped temporarily at that position and then deflected 
toward the next observer. This process is repeated at 
5 high speed allowing the observers to see a three-dimen- 
sional image. 

[0526] Fig. 87B illustrates a three-dimensional dis- 
play, which includes a reflector 5717 to distribute an op- 
tical axis from the three-dimensional display 5711 into 

10 a plurality of optical axes on a time division basis and 
reflect/refract light from the three-dimensional display 
toward each of a plurality of observers 5712, 5713, 
5714, 5715, 5716 so that all the observers can view the 
same three-dimensional image. Among devices used 

15 for the reflector 5717 are a half mirror, a total reflecting 
mirror and a prism. The reflector 571 7 deflects light from 
the three-dimensional display at high speed within the 
after image time of human eye between observer 5712 
and observer 5716 to distribute light to individual ob- 

20 servers. Light distribution can be achieved by recipro- 
cating the reflector to left and right at high speed or by 
rotating it in one direction. A shutter 5718 is operated at 
the same time that the reflection/refraction direction of 
light, while being deflected, aligns with the direction of 

25 each observer, thus allowing the observers to see a 
three-dimensional image. 

[0529] This arrangement can expand a viewing zone 
of an observer while moving or a viewing zone for a plu- 
rality of observers. 

30 [0530] The present invention has been described in 
detail in conjunction with example embodiments. It 
should be noted that the invention can be applied not 
only to the above-described three-dimensional displays 
but also as a means to expand a narrow viewing zone 

35 in general three-dimensional displays or stereoscopic 
displays. It should also be noted that the invention is not 
limited to these embodiments but various modifications 
may be made without departing from the spirit of the in- 
vention. 

40 [0531] The representative advantages of this inven- 
tion may be briefly summarized as follows. 
[0532] In three-dimensional displays or stereoscopic 
displays with narrow viewing zones, the viewing zone 
distributor installed to distribute a viewing zone from the 

45 display to a plurality of other directions allows expansion 
of the viewing zone or increase in the number of viewing 
zones, which in turn makes it possible for a plurality of 
people to simultaneously view the displayed image or 
for a moving observer to view the image. 

so [0533] In a three-dimensional display which gener- 
ates a three-dimensional image by displaying on a plu- 
rality of image planes at different depth positions two- 
dimensional images with brightness levels whose ratio 
corresponds to the depth position of each part of an ob- 

55 ject to be presented, the viewing zone distributor in- 
stalled to distribute the viewing zone from the display 
into a plurality of other directions allows expansion of 
the viewing zone while keeping the misalignment be- 
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tween the front and rear displayed images at a low level 
that does not appear incongruous to the observer. The 
provision of the viewing zone distributor also allows the 
three-dimensional image to be viewed by a plurality of 
observers simultaneously or to be seen by the observer 
while moving. 

[F-0002] 

[Center of Overlapping Two-Dimensional Images] 

[0534] In the preceding embodiments, the phenome- 
non of this invention occurs when the sizes of two-di- 
mensional images on the front and rear planes are con- 
trolled so that these two-dimensional images overlap as 
seen with the visual acuity of the observer from one point 
on a line connecting the left and right eyes of the ob- 
server. More precisely speaking, the essential require- 
ment for this phenomenon is that the two-dimensional 
images must overlap in the vertical direclion as viewed 
with the visual acuity of the observer from one point on 
a line connecting the left and right eyes of the observer. 
[0535] This is explained by referring to Figs. 8BA to 
88C. The best viewing position is at a middle point be- 
tween the loft and right eyes, as shown in Fig. 88A. This 
is because the double image of edge portions as seen 
from both eyes are smallest in this case. The viewing 
position from which the phenomenon of the invention 
can be observed is between both eyes, and the extreme 
allowable position is as shown in Fig. 88B. There is a 
possibility, however, that this phenomenon can still be 
observed even when the viewing position goes outside 
both eyes by a small amount undistinguishable from Fig. 
88B and stays within the visual acuity of the observer, 
as shown in Fig. 88C. When the viewing position moves 
further away, this phenomenon generally cannot be ob- 
served correctly, with the displayed images perceived 
as two separate front and rear two-dimensional images. 

[Coloring of Overlapping Two-Dimensional Images] 

[0536] With this invention, the apparent depth position 
of a perceived three-dimensional image can be changed 
by changing the ratio of brightness levels of the front 
and rear two-dimensional images. Hence, as shown in 
Fig. 89, the color of the front two-dimensional image (e. 
g., red in Fig. 89) and the color of the rear two-dimen- 
sional image (e.g., green in Fig. 89) can be differentiated 
from each other in such a way that the three-dimension- 
al image that is perceived by the observer when he sees 
these overlapping two-dimensional images has the in- 
tended color to be presented (e.g., yellow in Fig. 89). 

[Distance between Planes] 

[0537] The phenomenon of the present invention is 
produced when there are overlapping portions of the 
front and rear two-dimensional images in the right-eye 



72 

image and in the left-eye image, as shown in Fig. 90A. 
Hence, when the front and rear planes are set apart by 
a great distance and the front and rear two-dimensional 
images do not overlap and are separated in the right- 
5 eye image and in the teft-eye image, as shown in Fig. 
90 B, the phenomenon of interest is not generated and 
the observer perceives two separate front and rear two- 
dimensional images. 



[0538] Another example of the embodiment 28 is ex- 
plained by referring to Figs. 91 A and 91 B. Fig. 91 A il- 
lustrates an example case where a three-dimensional 

15 virtual image is produced. Fig. 91 B illustrates an exam- 
ple case where a three-dimensional real image is gen- 
erated. This embodiment includes a two-dimensional 
display (for example, CRT, liquid crystal display, LED 
display, PDP and FED), a varifocal lens (for example, 

20 dual-frequency type; see Japanese Patent Application 
182222/1996 titled "Optical Apparatus"; high-voltage 
liquid crystal type: see Japanese Patent Application 
202244/1996 titled "Optical Apparatus"; polarizing 
multifocal type; and liquid crystal motor type: see Japa- 

2S nese Patent Application 301 600/1 997 titled "Optical Ap- 
paratus"), an optical system (for example, concave lens, 
convex lens, concave mirror, convex mirror, total reflect- 
ing mirror, partial reflecting mirror, and prism). 
[0539] The varifocal lens, a key device in this embod- 

30 iment, can change its focal length at high speed and 
therefore can focus a displayed image of the two-dimen- 
sional display at different depth positions. Therefore, by 
synchronizing a change in the focal length of the varifo- 
cal lens driven by a driving device with an image display 

35 timing of the two-dimensional display by a synchronizing 
device and also by writing the images at all depth posi- 
tions within the after image time, it is possible to provide 
a three-dimensional representation in a depth sampling 
manner. 

40 [0540] The present invention has been described in 
detail with respect to preferred embodiments, and it will 
now be apparent from the foregoing to those skilled in 
the art that changes and modification may be made with- 
out departing from the invention in its broader aspect, 

« and it is the invention, therefore, in the apparent claims 
to cover ail such changes and modification as fall within 
the true spirit of the invention. 



1. A three-dimensional representation method for 
generating a three-dimensional image by display- 
ing two-dimensional images on a plurality of image 
planes located at different depth positions, the 
method characterized by comprising the steps of: 

generating two-dimensional images in which 
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an object to be presented is projected along the 
line oi sight of an observer, onto a plurality of 
image planes located at different depth posi- 
tions as seen from the observer; and 
changing brightness levels of the generated 
two-dimensional images individually for each 
image plane to display the generated two-di- 
mensional images on the plurality of image 
planes. 

2. A three-dimensional representation method as 
claimed in claim 1 , characterized in that, when the 
object to be presented is displayed at a depth posi- 
tion close to the observer, the brightness levels of 
the two-dimensional images displayed on those im- 
age planes of the plurality of image planes which 
are close to the observer are raised and the bright- 
ness levels of the two-dimensional images dis- 
played on the image planes remote from the ob- 
server are lowered, and 

characterized in that, when the object to be 
presented is displayed at a depth position remote 
from the observer, the brightness levels of the two- 
dimensional images displayed on those image 
planes of the plurality of image planes which arc 
close to the observer are lowered and the bright- 
ness levels of the two-dimensional images dis- 
played on the image planes remote from the ob- 
server are raised. 

3. A three-dimensional representation method as 
claimed in claim 1 , characterized in that the two-di- 
mensional images are displayed on the plurality of 
image planes in such a way that the two-dimension- 
al images overlap each other when the two-dimen- 
sional images are viewed from one point on a line 
which passes through the right and left eyes of an 
observer, and that an overall brightness level as 
seen by the observer is equal to the brightness level 
of the original object to be presented. 

4. A three-dimensional representation method as 
claimed in claim 3, characterized in that the point 
on the line which passes through the right and left 
eyes of the observer is one point between the right 
and left eyes. 

5. A three-dimensional representation method as 
claimed in claim 3, characterized in that the point 
on the line which passes through the right and left 
eyes of the observer is the point of the center be- 
tween the right and left eyes. 

6. A three-dimensional representation method as 
claimed in claim 1 , characterized in that the two-di- 
mensional images are arranged to overlap by view- 
ing from one point on the line which passes through 
the right and left of the observer and the two-dimen- 
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sional images are enlarged or reduced in the hori- 
zontal direction respectively. 

7. A three-dimensional representation method as 
s claimed in claim 2, characterized in that the two-di- 
mensional images are displayed on the plurality of 
image planes in such a way that the two-dimension- 
al images overlap each other when the two-dimen- 
sional images are viewed from one point on the line 

10 which passes through the right and left eyes of the 
observer and characterized in that when the depth 
position of the object to be presented is remote from 
the observer, an overall brightness level as seen by 
the observer is set lower than the brightness level 
1$ of the original object when the depth position of the 
object is close. 

8. A three-dimensional representation method as 
claimed in claim 1 , characterized in that the two-di- 

20 mensional images are switched successively to 
generate a three-dimensional moving image. 

9. A three-dimensional representation method as 
claimed in claim 8 : 

25 characterized in that when the two-dimen- 

sional images include a plurality of images of an ob- 
ject moving in a direction of depth and the object is 
moving toward the observer, the brightness levels 
of the object images displayed on the plurality of im- 
30 age planes are progressively raised toward an im- 
age plane close to the observer and progressively 
lowered toward an image plane remote from the ob- 
server in synchronism with the successive switch- 
ing of the two-dimensional images, and 
35 characterized in that when the two-dimen- 

sional images include a plurality of images of an ob- 
ject moving in a direction of depth and the object is 
moving away from the observer, the brightness lev- 
els of the object images displayed on the plurality 
40 of image planes are progressively lowered toward 
an image plane close to the observer and progres- 
sively raised toward an image plane remote from 
the observer in synchronism with the successive 
switching of the two-dimensional images. 

45 

10. A three-dimensional representation method as 
claimed in claim 1 , characterized in that distances 
of depth between the image planes are within a 
range having a common area in the case that a plu- 

50 rality of two-dimensional images are viewed by a 
single eye of the observer at the position of the right 
and left eyes of the observer, the plurality of two- 
dimensional images being displayed on the image 
planes for the same object to be presented. 

55 

11. A three-dimensional representation method as 
claimed in claim 1 , characterized in that the colors 
of the plurality of two-dimensional objects to be pre- 
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sented in the two-dimensional images are different 
each other, the color of a three-dimensional object 
to be represent is determined according to the dif- 
ferent colors and the colors of the plurality of the 
two-dimensional objects is possible to change with- 
out changing the determined color which is viewed 
by the observer. 

12. A three-dimensional display characterized by com- 
prising: 

a first means for generating two-dimensional 
images in which an object to be presented is 
projected along the line of sight of an observer, 
onto a plurality of image planes located at dif- 
ferent depth positions as seen from the observ- 
er; 

a second means for displaying the two-dimen- 
sional images generated by the first means on 
the plurality of image planes located at different 
depth positions as seen from the observer; and 
a third means for changing brightness levels of 
the two-dimensional images displayed on the 
plurality of image planes individually for each 
image plane. 

1 3. A three-dimensional display as claimed in claim 1 2, 
characterized in that the second means comprises: 

a plurality of two-dimensional displays; and 
partial reflecting mirrors combined with the plu- 
rality of two-dimensional displays except for 
one two-dimensional display located at the re- 
motest depth position from the observer, the 
partial reflecting mirrors being adapted to lo- 
cate images of the two-dimensional displays on 
the line of sight of the observer. 

14. A three-dimensional display as claimed in claim 1 2, 
characterized in that the second means comprises: 

a plurality of two-dimensional displays; and 
combinations of partial reflecting mirrors and 
lenses, the partial reflecting mirror and lens 
combinations being combined with the plurality 
of two-dimensional displays except for one two- 
dimensional display located at the remotest 
depth position from the observer, the partial re- 
flecting mirror and lens combinations being 
adapted to locate images of the two-dimension- 
al displays on the line of sight of the observer. 

15. A three-dimensional display as claimed in claim 1 2, 
characterized in that the second means comprises: 

a plurality of two-dimensional displays; 
a total reflecting mirror or partial reflecting mir- 
ror combined with one of the plurality of two- 



dimensional displays which is located at the re- 
motest depth position from the observer, the to- 
tal reflecting mirror or partial reflecting mirror 
being adapted to locate an image of the one 
s two-dimensional display on the line of sight of 

the observer; and 

partial reflecting mirrors combined with the two- 
dimensional displays except for the one two-di- 
mensional display located at the remotest 
10 depth position from the observer, the partial re- 

flecting mirrors being adapted to locate images 
of the two-dimensional displays on the line of 
sight of the observers. 

'5 1 6. A three-dimensional display as claimed in claim 1 2, 
characterized in that the second means comprises: 

a plurality of two-dimensional displays; 

a combination of a total reflecting mirror and a 

20 lens or a combination of a partial reflecting mir- 

ror and a lens, the combination being combined 
with one of the plurality of two-dimensional dis- 
plays which is located at the remotest depth po- 
sition from the observer, the combination being 

2S adapted to locate an image of the one two-di- 

mensional display on the line of sight of the ob- 
server; and 

combinations of partial reflecting mirrors and 
lenses, the combinations being combined with 

30 the two-dimensional displays except for one 

two-dimensional display located at the remot- 
est depth position from the observer, the com- 
binations being adapted to locate images of the 
two-dimensional displays on the line of sight of 

35 the observer. 

17. A three-dimensional display as claimed in claim 1 2, 
characterized in that the second means comprises: 

40 a plurality of scatter plates capable of control- 

ling a switching between a transmitting state 
and a scattering state or a plurality of reflection 
plates capable of controlling the switching be- 
tween a reflecting state and a transmitting 

45 state, the scatter plates or reflection plates be- 

ing located at different depth positions as 
viewed from the observer; 
a plurality of projection type two-dimensional 
displays for projecting two-dimensional images 

so onto the plurality of scatter plates or the plurality 

of reflection plates; and 
a plurality of shutters disposed between the plu- 
rality of scatter plates or reflection plates and 
the plurality of projection type two-dimensional 

55 displays, the plurality of shutters being adapted 

to switch between a transmitting state and a 
cutoff state in synchronism with the switching 
between the transmitting state and the scatter- 



39 



77 



EP 0 959 377 A2 



78 



ing state of the plurality of scatter plates or be- 
tween the reflecting state and the transmitting 
state of the plurality of reflection plates. 

18. A three-dimensional display as claimed in claim 1 2, s 
characterized in that a lens optical system is dis- 
posed between the observer and the plurality of im- 
age planes located at different depth positions as 
seen from the observer. 

70 

19. A three-dimensional display as claimed in claim 1 2, 
characterized in that the second means comprises: 

a two-dimensional display; 

an optical system; and is 

a varifocal mirror. 

20. A three-dimensional display as claimed in claim 1 2, 
characterized in that the second means comprises: 

20 

a vibration screen which vibrates in the direc- 
tion of depth; 

an optical system including a lens; 
a scanning means for raster-scanning a laser 
beam; and 2S 
a laser beam source. 

21. A three-dimensional display as claimed in claim 12, 
characterized in that the second means comprises: 

30 

an LED display having an LED array; 
a parallel advancing/rotating device for paral- 
lelly advancing/rotating the LED display; and 
a video feeding device for feeding a video sig- 
nal to the LED display. 35 

22. A three-dimensional display as claimed in claim 12, 
characterized in that the second means comprises: 

a film having a two-dimensional image record- 40 

ed therein or two-dimensional display; 

an image transforming optical system having a 

prism or mirror; and 

a projection drum. 

45 

23. A three-dimensional display as claimed in claim 12, 
characterized in that the second means comprises: 

a two-dimensional display; 

an optical system; so 
a varifocal lens having a variable focal length; 
a driving device for driving the varifocal lens; 
and 

a synchronizing device for synchronizing a 
change in the focal length of the varifocal lens ss 
with the displaying of an image of the two-di- 
mensional display. 



24. A three-dimensional display as claimed in claim 1 2, 
characterized in that the second means succes- 
sively switches the two-dimensional images gener- 
ated by the first means to generate a moving three- 
dimensional image. 

25. A three-dimensional display as claimed in claim 24, 

characterized in that when the two-dimen- 
sional images generated by the first means include 
a plurality of images of an object moving in a direc- 
tion of depth and the object is moving toward the 
observer, the third means progressively raises the 
brightness levels of the object images displayed on 
the plurality of image planes toward an image plane 
close to the observer and progressively lowers the 
brightness levels of the object images toward an im- 
age plane remote from the observer in synchronism 
with the successive switching of the two-dimension- 
al images by the second means, and 

characterized in that when the object is mov- 
ing away from the observer, the third means pro- 
gressively lowers the brightness levels of the object 
images displayed on the plurality of image planes 
toward an image plane close to the observer and 
progressively raises the brightness levels of the ob- 
ject images toward an image plane remote from the 
observer in synchronism with the successive 
switching of the two-dimensional images by the 
second means. 

26. A three-dimensional display as claimed in claim 1 2. 
characterized in that the colors of the plurality of 
two-dimensional objects to be presented in the two- 
dimensional images are different each other, the 
color of a three-dimensional object to be represent- 
ed is determined to the different colors and the 
colors of the plurality of the two-dimensional objects 
is possible to change without changing the deter- 
mined color which is viewed by the observer. 

27. A three-dimensional representation method char- 
acterized by comprising the steps of: 

generating two-dimensional images by in which 
an object is projected along the line of sight of 
an observer, onto a plurality of image planes 
located at different depth positions as seen 
from an observer; 

changing brightness levels of the generated 
two-dimensional images and displaying them 
on the respective image planes; and 
detecting the movement of a viewing point of 
the observer in longitudinal, horizontal and ver- 
tical directions to change the two-dimensional 
images displayed on respective displays ac- 
cording to the detected movement of the view- 
ing point. 
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28. A three-dimensional representation method as 
claimed in claim 27, characterized in that the dis- 
plays displaying the plurality of two-dimensional im- 
ages are parallelly moved according to the move- 
ment of the viewing point of the observer. s 

29. A three-dimensional representation method as 
claimed in claim 27, characterized in that, according 
to the movement of the viewing point of the observ- 
er, the plurality of two-dimensional images are re- 10 
written into images as they will appear when viewed 
from the direction of the observer. 

30. A three-dimensional representation method char- 
acterized by comprising the steps of: '5 

generating two-dimensional images in which 
an object is projected along the line of sight of 
an observer, onto a plurality of image planes 
located at different depth positions as seen 20 
from an observer; 

distributing the generated two-dimensional im- 
ages to respective displays and changing 
brightness levels of the two-dimensional imag- 
es according to depth positions where the two- 2s 
dimensional images are to be displayed, and 
displaying them on the respective image 
planes; and 

detecting the movement of a viewing point of 
the observer in longitudinal, horizontal and ver- 30 
tical directions to change the two-dimensional 
images displayed on the respective displays 
according to the detected movement of the 
viewing point. 

35 

31. A three-dimensional representation method as 
claimed in claim 27, characterized in that, according 
to the movement of the viewing point of the observ- 
er, the plurality of two-dimensional images are sub- 
jected to one or more of transformation processing *o 
including parallel movement, enlargement and re- 
duction. 

32. A three-dimensional display characterized by com- 
prising: 45 

a two-dimensional image generating device for 
generating two-dimensional images in which 
an object is projected along the line of sight of 
an observer, onto a plurality of image planes so 
located at different positions as seen from the 
observer; 

a brightness level changing device for changing 
brightness levels of the two-dimensional imag- 
es and displaying them on the image planes; ss 
a viewing point movement detecting device for 
detecting the movement of a viewing point of 
the observer in longitudinal, horizontal and ver- 
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tical directions; 

a two-dimensional image transformation de- 
vice for changing the two-dimensional images 
according to the detected movement of the 
viewing point; and 

displays for displaying the transformed two-di- 
mensional images. 

33. A three-dimensional display as claimed in claim 32, 
characterized in that the two-dimensional image 
transformation device has one or more of transfor- 
mation processing means for parallelly moving, en- 
larging and reducing the plurality of two-dimension- 
.al images according to the movement of the viewing 
point of the observer. 

34. A three-dimensional display as claimed in claim 32, 
further including a means for parallelly moving the 
displays for displaying the plurality of two-dimen- 
sional images according to the movement of the 
viewing point of the observer. 

35. A three-dimensional display characterized by com- 
prising: 

a two-dimensional image generating device for 
generating two-dimensional images in which 
an object is projected along the line of sight of 
an observer, onto a plurality of image planes 
located at different positions as seen from the 
observer; 

a distribution device for distributing the gener- 
ated two-dimensional images to displays ac- 
cording to depth positions where the two-di- 
mensional images are to be displayed, the dis- 
plays corresponding to the respective depth po- 
sitions; 

a brightness level changing device for changing 
brightness levels of the two-dimensional imag- 
es and displaying them on the image planes; 
a viewing point movement detecting device for 
detecting the movement of a viewing point of 
the observer in longitudinal, horizontal and ver- 
tical directions; 

a two-dimensional image transformation de- 
vice for changing the two-dimensional images 
according to the detected movement of the 
viewing point; and 

displays for displaying the transformed two-di- 
mensional images. 

36. A three-dimensional display as claimed in claim 32, 
characterized in that the viewing point movement 
detecting device comprises one or more of an infra- 
red sensor, an ultrasonic sensor, a laser distance 
sensor, an optical sensor, a camera image-based 
position detection, and a magnetic sensor. 
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37. A three-dimensbnal representation method which 
generates a three-dimensional image in which an 
object to be presented onto planes is projected 
along the line of sight of an observer, by displaying 
the two-dimensional images on a plurality o1 image 5 
planes simultaneously and at desired brightness 
levels, the plurality of image planes being located 

at different depth positions, the three-dimensional 
representation method characterized by compris- 
ing the steps of: io 

selecting one of the plurality of objects when 
the object to be presented comprises a plurality 
of objects having different depth positions; 
generating two-dimensional images by in which is 
the selected object is projected onto planes 
along the line of sight of the observer; 
displaying the generated two-dimensional im- 
ages on the plurality of image planes simulta- 
neously; and 20 
repeating the above three steps for all of the 
plurality of objects within an after image time of 
human eye to successively display three-di- 
mensional images of the plurality of objects on 
a time division basis within the after image time 2S 
of human eye. 

38. A three-dimensional representation method as 
claimed in claim 37, characterized in that when the 
two-dimensional images are displayed on the plu- 30 
rality of image planes simultaneously for a plurality 

of objects, the brightness levels of the two-dimen- 
sional images displayed on the image planes are 
changed to desired brightness levels individually for 
each two-dimensional image. 35 

39. A three-dimensional representation method as 
claimed in claim 37, characterized in that the bright- 
ness levels of the plurality of image planes are 
changed periodically; in synchronism with the *o 
brightness levels of the image planes becoming de- 
sired levels, an object is selected from the plurality 

of objects of two-dimensional images to be dis- 
played at the desired brightness levels and the two- 
dimensional images of the selected object are dis- 45 
played on the plurality of image planes simultane- 
ously; and this process is perlormed successively 

40. A three-dimensional display characterized by com- 
prising: so 

a two-dimensional image generating means for 
generating two-dimensional images in which 
one object of a plurality of objects to be present- 
ed, the plurality of objects having different 55 
depth positions, is selected one by one and se- 
lected object is projected onto the planes along 
the line of sight of an observer; 
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a display means for displaying the two-dimen- 
sional images generated by the two-dimension- 
al image generating means simultaneously on 
a plurality of image planes for one selected ob- 
ject after another, the image planes being lo- 
cated at different depth positions as seen from 
the observer, the display means being adapted 
to repetitively display all of the two-dimensional 
images generated by the two-dimensional im- 
age generating means successively within an 
after image time of human eye; and 
a brightness level adjusting means for adjusting 
brightness levels of the two-dimensional imag- 
es displayed on the image planes of the display 
means in synchronism with the displaying of the 
two-dimensional images on the image planes 
of the display means. 

41 . A three-dimensional display as claimed in claim 40, 
characterized in that the brighlness level adjusting 
means changes the brightness level periodically 
and, in synchronism with the brightness level being 
changed by the brightness level adjusting means, 
the two-dimensional image generating means se- 
lects an object from the plurality of objects of two- 
dimensional images to be displayed at desired 
brightness levels, and generates the two-dimen- 
sional images of the selected object. 

42. A three-dimensional display as claimed in claim 40, 
characterized in that the two-dimensional image 
generating means selects one object after another 
from the plurality of objects in a predetermined or- 
der and generates two-dimensional images of the 
selected object, and the brightness level adjusting 
means changes the brightness level in synchronism 
with the two-dimensional images being generated 
by the two-dimensional image generating means. 

43. A three-dimensional display characterized by com- 
prising. 

a two-dimensional image generating means for 
generating two-dimensional images in which 
one object of a plurality of objects to be present- 
ed is selected one by one the plurality of objects 
having different depth positions, and the select- 
ed object is projected on to the planes along 
the line of sight of an observer; and 
a display means for displaying the two-dimen- 
sional images generated by the two-dimension- 
al image generating means simultaneously on 
a plurality of image planes at predetermined 
brightness levels for one selected object after 
another, the image planes being located at dif- 
ferent depth positions as seen from the observ- 
er, the display means being adapted to repeti- 
tively display all of the two-dimensional images 
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generated by the two-dimensional image gen- 
erating means successively within an after im- 
age time of human eye; 
wherein the display means includes: 
a two-dimensional display means located at 
each image plane to display two-dimensional 
images generated by the two-dimensional im- 
age generating means; and 
a brightness level adjusting means disposed in 
front of the two-dimensional display means. 

44. A three-dimensional display as claimed in claim 43, 
characterized in that the brightness level adjusting 
means changes the brightness level periodically 
and, in synchronism with the brightness level being 
changed by the brightness level adjusting means, 
the two-dimensional image generating means se- 
lects an object from the plurality of objects to be pre- 
sented at desired brightness level, and generates 
the two-dimensional images for the selecled object. 

45. A three-dimensional display as claimed in claim 43, 
characterized in that the two-dimensional image 
generating means selects one object after another 
from the plurality of objects in a predetermined or- 
der and generates two-dimensional images for the 
selected object, and the brightness level adjusting 
means changes the brightness level in synchronism 
with the two-dimensional images being generated 
by the two-dimensional image generating means. 

46. A three-dimensional display as claimed in claim 43, 
characterized in that the brightness level adjusting 
means is a beam attenuating filter. 

47. A three-dimensional display as claimed in claim 46, 
characterized in that the beam attenuating filter is 
either a rotary filter which continuously changes 
light intensity attenuation, a filter that rotates a plu- 
rality of slits, a fitter that changes an interruption/ 
transmission time by a shutter, or a filter that chang- 
es a number of times of interruptions/transmissions 
by a shutter. 

48. A three-dimensional display as claimed in claim 43, 
characterized in that the two-dimensional display 
means is a display which can randomly access pix- 
els. 

49. A three-dimensional display characterized by com- 
prising: 

a two-dimensional image generating means for 
generating two-dimensional images in which 
one object of a plurality of objects is selected 
one by one, the plurality of objects having dif- 
ferent depth positions, and the selected object 
is projected on to the planes along the line of 
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sight of an observer; and 
a display means for displaying the two-dimen- 
sional images generated by the two-dimension- 
al image generating means simultaneously on 
a plurality of image planes at predetermined 
brightness levels for one selected object after 
another, the image planes being located at dif- 
ferent depth positions as seen from the observ- 
er, the display means being adapted to repeti- 
tively display all of the two-dimensional images 
generated by the two-dimensional image gen- 
erating means successively within an after im- 
age time of human eye; 
wherein the display means includes: 
a plurality of two-dimensional display means lo- 
cated at each image plane to display predeter- 
mined two-dimensional images of a plurality of 
two-dimensional images generated by the two- 
dimensional image generating means; and 
a brightness level adjusting means disposed in 
front of the plurality of two-dimensional display 
means. 

50. A three-dimensional display as claimed in claim 49, 
25 characterized in that the brightness level adjusting 

means changes the brightness level periodically 
and, in synchronism with the brightness level being 
changed by the brightness level adjusting means, 
the two-dimensional image generating means se- 
30 lects an object from the plurality of objects to be ob- 
jected at desired brightness level, and generates 
the two-dimensional images for the selected object. 

51 . A three-dimensional display as claimed in claim 49, 
35 characterized in that the two-dimensional image 

generating means selects one object after another 
from the plurality of objects in a predetermined or- 
der and generates two-dimensional images of the 
selected object, and the brightness level adjusting 
40 means changes the brightness levels in synchro- 
nism with the two-dimensional images being gen- 
erated by the two-dimensional image generating 
means. 

45 52. A three-dimensional display as claimed in claim 51 , 
characterized in that the two-dimensional display 
means are a plurality of projectors, and the display 
means further includes screens provided one for 
each image plane on which the two-dimensional im- 

so ages are projected from the plurality of projectors. 

53. A three-dimensional display as claimed in claim 51 , 
characterized in that the brightness level adjusting 
means is a beam attenuating filter. 

55 

54. A three-dimensional display as claimed in claim 53, 
characterized in that the beam attenuating filter is 
either a rotary filter which continuously changes 
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light intensity attenuation, a filter that rotates a plu- 
rality of slits, a filter that changes an interruption/ 
transmission time by a shutter, or a filter that chang- 
es a number of times of interruptions/transmissions 
by a shutter. 

55. A three-dimensional display as claimed in claim 51 , 
characterized in that the two-dimensional display 
means are displays which can randomly access pix- 
els. 

56. A three-dimensional display characterized by com- 
prising: 

a two-dimensional image generating means for 
generating two-dimensional images in which 
one object of a plurality of objects is selected 
one by one, the plurality of objects having dif- 
ferent depth positions, the selected object is 
projected on to along the line of sight of an ob- 
server; and 

a display means for displaying the two-dimen- 
sional images generated by the two-dimension- 
al image generating means simultaneously on 
a plurality of image planes at predetermined 
brightness levels for one selected object after 
another, the image planes being located at dif- 
ferent depth positions as seen from the observ- 
er, the display means being adapted to repeti- 
tively display all of the two-dimensional images 
generated by the two-dimensional image gen- 
erating means successively within an after im- 
age time of human eye; 
wherein the display means includes: 
a two-dimensional display means located at 
each image plane to display two-dimensional 
images generated by the two-dimensional im- 
age generating means at the predetermined 
brightness levels. 

57. A three-dimensional display as claimed in claim 56, 
characterized in that the two-dimensional display 
means changes the brightness level periodically 
and, in synchronism with the brightness level being 
changed by the two-dimensional display means, 
the two-dimensbnal image generating means se- 
lects an object from the plurality of objects which 
has two-dimensional images to be displayed at de- 
sired brightness levels, and generates the two-di- 
mensional images of the selected object. 

58. A three-dimensional display as claimed in claim 56, 
characterized in that the two-dimensional image 
generating means selects one object after another 
from the plurality of objects in a predetermined or- 
der and generates two-dimensional images of the 
selected object, and the two-dimensional display 
means changes the brightness level in synchronism 



with the two-dimensional images being generated 
by the two-dimensional image generating means. 

59. A three-dimensional display as claimed in claim 56, 
s characterized in that the two-dimensional display 

means is a display which can randomly access pix- 
els. 

60. A three-dimensional display characterized by com- 
io prising: 

a two-dimensional image generating means for 
generating two-dimensional images in which 
one object after of a plurality of objects is se- 
15 lected one by one, the plurality of objects hav- 

ing different depth positions, and selected ob- 
ject is projected on to the planes along the line 
of sight of an observer; and 
a display means for displaying the two-dimen- 
20 sional images generated by the two-dimension- 

al image generating means simultaneously on 
a plurality of image planes at predetermined 
brightness levels for one selected object after 
another, the image planes being located at dif- 
25 ferent depth positions as seen from the observ- 

er, the display means being adapted to repeti- 
tively display all of the two-dimensional images 
generated by the two-dimensional image gen- 
erating means successively within an after im- 
30 age time of human eye; 

wherein the display means includes: 
a plurality of two-dimensional display means lo- 
cated at each image plane to display at prede- 
termined brightness levels predetermined two- 
35 dimensional images of a plurality of two-dimen- 

sional images generated by the two-dimension- 
al image generating means. 

61. A three-dimensional display according to claim 60, 
40 characterized in that the two-dimensional display 

means changes the brightness level periodically 
and, in synchronism with the brightness level being 
changed by the two-dimensional display means, 
the two-dimensional image generating means se- 
45 lects an object from the plurality of objects which 
has two-dimensional images to be displayed at de- 
sired brightness levels, and generates the two-di- 
mensional images of the selecled object. 

50 62. A three-dimensional display according to claim 60, 
characterized in that the two-dimensional image 
generating means selects one object after another 
from the plurality of objects in a predetermined or- 
der and generates two-dimensional images for the 

55 selected object, and the two-dimensional display 
means changes the brightness levels in synchro- 
nism with the two-dimensional images being gen- 
erated by the two-dimensional image generating 
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means. 

63. A three-dimensional display according to claim 60, 
characterized in that the two-dimensional display 
means is a display which can randomly access pix- 
els. 

64. In a three-dimensional representation method 
which generates a three-dimensional image by dis- 
playing the two-dimensional images on all of a plu- 
rality of image planes at desired brightness levels, 
an object to be presented of two-dimensional imag- 
es being projected on to the planes, and within an 
after image time of human eye, the plurality of im- 
age planes being located at different depth posi- 
tions, the three-dimensional representation method 
characterized by comprising the steps of: 

controlling a polarization direction of display 
light of the two-dimensional images; and 
passing the display light through an optical sys- 
tem that has different focusing positions ac- 
cording to the polarization direction of the pass- 
ing display light so that the display light of the 
two-dimensional images is focused on the plu- 
rality of image planes located at different depth 
positions to display the two-dimensional imag- 
es on the plurality of image planes located at 
different depth positions. 

65. A three-dimensional representation method as 
claimed in claim 64, characterized in that while the 
two-dimensional images are successively 
switched, the polarization direction of the display 
light of the two-dimensional images is successively 
switched to focus the display light of the two-dimen- 
sional images on the plurality of image planes lo- 
cated at different depth positions to generate a 
three-dimensional moving image. 

66. A three-dimensional representation method as 
claimed in claim 64, characterized in that, in syn- 
chronism with the successive switching of the po- 
larization direction of the display light of the two-di- 
mensional images, the brightness levels of the dis- 
play light of the two-dimensional images are 
changed to desired brightness levels. 

67. A three-dimensional representation method as 
claimed in claim 65, characterized in that the polar- 
ization direction of the display light of the two-di- 
mensional images is controlled to adjust to desired 
levels the brightness levels of the two-dimensional 
images focused on the plurality of image planes lo- 
cated at different depth positions. 

68. A three-dimensional display characterized by com- 
prising: 
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a two-dimensional image display means for dis- 
playing two-dimensional images; 
a polarization varying means for controlling a 
polarization direction of display light of the two- 
dimensional images entering from the two-di- 
mensional image display means and then out- 
putting the display light; and 
a polarization type bifocal optical system for 
splitting the display light exiting from the polar- 
ization varying means into two independent po- 
larization directions and focusing the two inde- 
pendent polarization direction beams on two 
different image planes; 

wherein the two-dimensional image display 
means, the polarization varying means and the 
polarization type bifocal optical system are ar- 
ranged so that the two-dimensional images fo- 
cused on the two different image planes over- 
lap each other on the line of sight of an observer 
and have different depth positions. 

69. A three-dimensional display as claimed in claim 68, 
characterized in that the two-dimensional image 
display means changes brightness levels of the 

2S two-dimensional images in synchronism with the 
changing of the polarization direction by the polari- 
zation varying means. 

70. A three-dimensional display as claimed in claim 68, 
30 characterized in that the polarization varying means 

changes the display light of the two-dimensional im- 
ages entering from the two-dimensional image dis- 
play means into elliptically polarized light. 

35 71 . A three-dimensional display as claimed in claim 68, 
characterized in that the polarization varying means 
changes the display light of the two-dimensional im- 
ages entering from the two-dimensional image dis- 
play means into linearly polarized light having the 
40 two independent polarization directions split by the 
polarization type bifocal optical system or an inter- 
mediate polarization angle between the two inde- 
pendent polarization directions. 

45 72. A three-dimensional display as claimed in claim 68, 
characterized in that the polarization varying means 
includes a medium whose birefringence is changed 
by application of electric field or voltage. 

so 73. A three-dimensional display as claimed in claim 68, 
characterized in that the medium whose birefrin- 
gence is changed, is a liquid crystal. 

74. A three-dimensional display as claimed in claim 68, 
55 characterized in that the two-dimensional image 
display means has a plurality of pixels, the polari- 
zation varying means has a plurality of polarization 
varying elements, and each of the polarization var- 
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ying elements of the polarization varying means 
controls polarization of display light of one or more 
pixels of the two-dimensional image display means. 

75. A three-dimensional display as claimed in claim 68, 
characterized in that the polarization type bifocal 
optical system includes a fixed focus lens of an iso- 
tropic medium and a birefringent medium. 

76. A three-dimensional display as claimed in claim 68, 
characterized in that the polarization type bifocal 
optical system includes a lens-shaped birefringent 
medium. 

77. A three-dimensional display as claimed in claim 75, 
characterized in that the birefringent medium is a 
liquid crystal. 

78. A three-dimensional display as claimed in claim 68, 
characterized in that the polarization type bifocal 
optical system includes: 

a first polarizing beam splitter for splitting the 
display light output from the polarization vary- 
ing means into two independent polarization di- 
rections; 

two optical systems passing the two split dis- 
play beams separated by the first polarizing 
beam splitter and having different image focus- 
ing positions; and 

a second polarizing beam splitter for synthesiz- 
ing the two split display beams that have 
passed through the two optical systems. 

79. A three-dimensional display as claimed in claim 78, 
characterized in that the first or second polarizing 
beam splitter is replaced with two polarizing plates 
having polarization directions different from that of 
the beam splitter. 

80. A three-dimensional representation method which 
generates a three-dimensional image by arranging 
a plurality of image planes at different depth posi- 
tions for each ot left and right eyes of an observer 
and by displaying two-dimensional images on the 
plurality ot image planes for each ol the left and right 
eyes ot the observer, the three-dimensional repre- 
sentation method characterized by comprising the 
steps of: 

generating two-dimensional images in which 
an object to be presented is projected from a 
point on a line passing through the left and right 
eyes of the observer onto the plurality of image 
planes; 

changing brightness levels of the generated 
two-dimensional images individually for each 
image plane for the left eye and for the right eye 



of the observer; and 

displaying the generated two-dimensional im- 
ages on the plurality of image planes for the left 
eye and for right eye of the observer. 

5 

81. A three-dimensional representation method as 
claimed in claim 80, 

characterized in that, when the object to be 
presented is displayed at a depth position close to 

io the observer, the brightness levels of the two-di- 
mensional images displayed on those image planes 
of the plurality of image planes which are close to 
the observer are raised and the brightness levels of 
the two-dimensional images displayed on the im- 

is age planes remote from the observer are towered, 
and 

characterized in that, when the object to be 
presented is displayed at a depth position remote 
from the observer, the brightness levels of the two- 

20 dimensional images displayed on those image 
planes of the plurality of image planes which are 
close to the observer are lowered and the bright- 
ness levels of the two-dimensional images dis- 
played on the image planes remote from the ob- 

25 server are raised. 

82. A three-dimensional representation method as 
claimed in claim 81, characterized in that the two- 
dimensional images are displayed on the plurality 

30 of image planes so that they overlap each other 
when seen from one point on a line passing through 
the left and right eyes of the observer, and the 
brightness levels of the two-dimensional images 
displayed on the plurality of image planes are 

35 changed so that an overall brightness level as seen 
by the observer is equal to the brightness level of 
the original object to be presented. 

83. A three-dimensional representation method as 
40 claimed in claim 80, characterized in that the two- 
dimensional images are displayed on the plurality 
of image planes so that they overlap each other 
when seen from one point on a line passing through 
the left and right eyes of the observer, and the 

« brightness levels of each part of the two-dimension- 
al images displayed on the plurality ot image planes 
are changed according to the depth position of the 
original object lo be presented so that an overall 
brightness level as seen by the observer is equal to 

so the brightness level of the object to be presented. 

84. A three-dimensional representation method as 
claimed in claim 80, characterized in that the two- 
dimensional images are successively switched to 

55 generate a three-dimensional moving image. 

85. A three-dimensional representation method as 
claimed in claim 84, 
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characterized in that when the two-dimen- 
sional images include a plurality of images of an ob- 
ject moving in a direction of depth and the object is 
moving toward the observer, the brightness levels 
of the object images displayed on the plurality of im- 
age planes are progressively raised from an image 
plane remote from the observer toward an image 
plane close to the observer in synchronism with the 
successive switching of the two-dimensional imag- 
es, and 

characterized in that when the two-dimen- 
sional images include a plurality of images of an ob- 
ject moving in a direction of depth and the object is 
moving away from the observer, the brightness lev- 
els of the object images displayed on the plurality 
of image planes are progressively raised from an 
image plane close to the observer toward an image 
plane remote from the observer in synchronism with 
the successive switching of the two-dimensional im- 
ages. 

86. A head-mounted display for displaying a three-di- 
mensional image by displaying two-dimensional im- 
ages on a plurality of image planes located at dif- 
ferent depth positions as seen by an observer, the 
head-mounted display characterized by compris- 
ing: 

a first means for fixing relative positions be- 
tween the plurality of image planes and left and 
right eyes of the observer; 
a second means for generating two-dimension- 
al images in which an object to be presented 
from one point on a line passing through the left 
and right eyes of the observer onto the plurality 
of image planes; 

a third means for displaying the two-dimension- 
al images generated by the image generating 
means on at least two of the plurality of image 
planes; and 

a fourth means for changing brightness levels 
of the two-dimensional images displayed on the 
at least two image planes individually for each 
image plane. 

87. A head-mounted display as claimed in claim 86, 
characterized in that the third means comprises: 

a plurality of two-dimensional displays; 
a total reflecting mirror or partial reflecting mir- 
ror combined with one of the plurality of two- 
dimensional displays which is located at the re- 
motest depth position from the observer, the to- 
tal reflecting mirror or partial reflecting mirror 
being adapted to locate an image of the one 
two-dimensional display on the line of sight of 
the observer; and 

partial reflecting mirrors combined with the two- 



dimensional displays except for the one two-di- 
mensional display located at the remotest 
depth position from the observer, the partial re- 
flecting mirrors being adapted to locate images 
of the two-dimensional displays on the line of 
sight of the observers. 

88. A head-mounted display as claimed in claim 86, 
characterized in that the third means comprises: 

a plurality of two-dimensional displays; 
a combination of a total reflecting mirror and a 
lens or a combination of a partial reflecting mir- 
ror and a lens, the combination being combined 
with one of the plurality of two-dimensional dis- 
plays which is located at the remotest depth po- 
sition from the observer, the combination being 
adapted to locate an image of the one two-di- 
mensional display on the line of sight of the ob- 
server; and 

combinations of partial reflecting mirrors and 
lenses, the combinations being combined with 
the two-dimensional displays except for the one 
two-dimensional display located at the remot- 
est depth position from the observer, the com- 
binations being adapted to locate images of the 
two-dimensional displays on the line of sight of 
the observer. 

89. A head-mounted display as claimed in claim 86, 
characterized in that the third means comprises: 

a plurality of scatter plates capable of control- 
ling a switching between a transmitting state 
and a scattering state, the scatter plates being 
located at different depth positions as viewed 
from the observer; 

a plurality of projection type two-dimensional 
displays for projecting two-dimensional images 
onto the plurality of scatter plates; and 
a plurality of shutters disposed between the plu- 
rality of scatter plates and the plurality of pro- 
jection type two-dimensional displays, the plu- 
rality of shutters being adapted to switch be- 
tween a transmitting state and a cutoff state in 
synchronism with the switching between the 
transmitting state and the scattering state of the 
plurality of scatter plates. 



so 90. A head-mounted display as claimed in claim 86, 
characterized in that a lens optical system is dis- 
posed between the plurality of image planes and the 
observer. 

55 91. A head-mounted display as claimed in claim 86, 

characterized in that, when the object to be 
presented is displayed at a depth position close to 
the observer, the fourth means raises the bright- 
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ness levels of the two-dimensional images dis- 
played on those image planes of the plurality of im- 
age planes which are close to the observer and low- 
ers the brightness levels of the two-dimensional im- 
ages displayed on the image planes remote from * 
the observer, and 

characterized in that, when the object to be 
presented is displayed at a depth position remote 
from the observer, the fourth means lowers the 
brightness levels of the two-dimensional images n> 
displayed on those image planes of the plurality of 
image planes which are close to the observer and 
raises the brightness levels of the two-dimensional 
images displayed on the image planes remote from 
the observer. is 

92. A head-mounted display as claimed in claim 86, 
characterized in that the third means displays the 
two-dimensional images on the plurality of image 
planes so that Ihey overlap each other when viewed ^o 
from one point on a line passing through the left and 
right eyes of the observer, and the fourth means 
changes the brightness levels of the two-dimen- 
sional images displayed on the plurality of image 
planes so that an overall brightness level as seen 2$ 
by the observer is equal to the brightness level of 
the original object to be presented. 

93. A head-mounted display as claimed in claim 86, 
characterized in that the third means displays the 30 
two-dimensional images on the plurality of image 
planes so that they overlap each other when viewed 
from one point on a line passing through the left and 
right eyes of the observer, and the fourth means 
changes the brightness levels of each part of the 35 
two-dimensional images displayed on the plurality 

of image planes according to the depth position of 
the original object to be presented so that an overall 
brightness level as seen by the observer is equal to 
the brightness level of the object to be presented. 40 

94. A head-mounted display as claimed in claim 86, 
characterized in that the third means successively 
switches and displays the two-dimensional images 
generated by the image generating means to dis- *s 
play a three-dimensional moving image. 

95. A head-mounted display as claimed in claim 94, 

characterized in that when the two-dimen- 
sional images generated by the first means include so 
a plurality of images of an object moving in a direc- 
tion of depth and the object is moving toward the 
observer, the fourth means progressively raises the 
brightness levels of the object images displayed on 
the plurality of image planes from an image plane ss 
remote from the observer toward an image plane 
close to the observer in synchronism with the suc- 
cessive switching of the two-dimensional images by 



the third means, and 

characterized in that when the object is mov- 
ing away from the observer, the fourth means pro- 
gressively raises the brightness levels of the object 
images displayed on the plurality of image planes 
from an image plane close to the observer toward 
an image plane remote from the observer in syn- 
chronism with the successive switching of the two- 
dimensional images by the third means. 

96. A head-mounted display for displaying a three-di- 
mensional image by displaying two-dimensional im- 
ages on a plurality of image planes located at dif- 
ferent depth positions as seen from a left eye of an 
observer and on a plurality of image planes located 
at different depth positions as seen from a right eye 
of the observer the head-mounted display charac- 
terized by comprising: 

a first means for fixing relative positions be- 
tween the plurality of image planes for the left 
eye and the left eye of the observer and be- 
tween the plurality of image planes for the right 
eye and the right eye of the observer; 
a second means for generating two-dimension- 
al images in which an object to be projected 
from one point on a line passing through the left 
and right eyes of the observer onto the plurality 
of image planes for the left eye and for the right 
eye; 

a third means for displaying the two-dimension- 
al images generated by the image generating 
means on at least two of the plurality of image 
planes for the left eye and for the right eye; and 
a fourth means for changing brightness levels 
of the two-dimensional images displayed on the 
at least two image planes individually at least 
two image planes at a time for the left eye and 
for the right eye. 

97. A head-mounted display as claimed in claim 96, 
characterized in that the third means comprises: 

a plurality of two-dimensional displays; 
a total reflecting mirror or partial reflecting mir- 
ror combined with one of the plurality of two- 
dimensional displays which is located at the re- 
motest deplh position from the observer, the to- 
tal reflecting mirror or partial reflecting mirror 
being adapted to locate an image of the one 
two-dimensional display on the line of sight of 
the observer; and 

partial reflecting mirrors combined with the two- 
dimensional displays except for the one two-di- 
mensional display located at the remotest 
depth position from the observer, the partial re- 
flecting mirrors being adapted to locate images 
of the two-dimensional displays on the line of 
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sight of the observers. 

98. A head-mounted display as claimed in claim 96, 
characterized in that the third means comprises: 

5 

a plurality of two-dimensional displays; 
a combination of a total reflecting mirror and a 
lens or a combination of a partial reflecting mir- 
ror and a lens, the combination being combined 
with one of the plurality of two-dimensional dis- 10 
plays which is located at the remotest depth po- 
sition from the observer, the combination being 
adapted to locate an image of the one two-di- 
mensional display on the line of sight of the ob- 
server; and is 
combinations of partial reflecting mirrors and 
lenses, the combinations being combined with 
the two-dimensional displays except for the one 
two-dimensional display located at the remot- 
est depth position from the observer, the com- 20 
binations being adapted to locate images of the 
two-dimensional displays on the line of sight of 
the observer. 

99. A head-mounted display as claimed in claim 96, 2$ 
characterized in that the third means comprises: 

a plurality of scatter plates capable of control- 
ling a switching between a transmitting state 
and a scattering state, the scatter plates being 30 
located at different depth positions as viewed 
from the observer; 

a plurality of projection type two-dimensional 
displays for projecting two-dimensional images 
onto the plurality of scatter plates; and 35 
a plurality of shutters disposed between the plu- 
rality of scatter plates and the plurality of pro- 
jection type two-dimensional displays, the plu- 
rality of shutters being adapted to switch be- 
tween a transmitting state and a cutoff state in *o 
synchronism with the switching between the 
transmitting state and the scattering state of the 
plurality of scatter plates. 

100. A head-mounted display as claimed in claim 89, 45 
characterized in that a lens optical system is dis- 
posed between the plurality of image planes and the 
observer. 

101 .A head-mounted display as claimed in claim 96, so 
characterized in that, when the object to be 
presented is displayed at a depth position close to 
the observer, the fourth means raises the bright- 
ness levels of the two-dimensional images dis- 
played on those image planes of the plurality of im- 55 
age planes which are close to the observer and low- 
ers the brightness levels of the two-dimensional im- 
ages displayed on the image planes remote from 



the observer, and 

characterized in that, when the object to be 
presented is displayed at a depth position remote 
from the observer, the fourth means lowers the 
brightness levels of the two-dimensional images 
displayed on those image planes of the plurality of 
image planes which are close to the observer and 
raises the brightness levels of the two-dimensional 
images displayed on the image planes remote from 
the observer. 

102. A head-mounted display as claimed in claim 96, 
characterized in that the third means displays the 
two-dimensional images on the plurality of image 
planes so that they overlap each other when viewed 
from one point on a line passing through the left and 
right eyes of the observer, and the fourth means 
changes the brightness levels of the two-dimen- 
sional images displayed on the plurality of image 
planes so that an overall brightness level as seen 
by the observer is equal to the brightness level of 
the original object to be presented. 

103. A head-mounted display as claimed in claim 96, 
characterized in that the third means displays the 
two-dimensional images on the plurality of image 
planes so that they overlap each other when viewed 
from one point on a line passing through the left and 
right eyes of the observer, and the fourth means 
changes the brightness levels of each part of the 
two-dimensional images displayed on the plurality 
of image planes according to the depth position of 
the original object to be presented so that an overall 
brightness level as seen by the observer is equal to 
the brightness level of the object to be presented. 

104. A head-mounted display as claimed in claim 96, 
characterized in that the third means successively 
switches the two-dimensional images generated by 
the image generating means to display a two-di- 
mensional moving image. 

105. A head-mounted display as claimed in claim 1 04, 

characterized in that when the two-dimen- 
sional images generated by the first means include 
a plurality of images of an object moving in a direc- 
tion of depth and the object is moving toward the 
observer, the fourth means progressively raises the 
brightness levels of the object images displayed on 
the plurality of image planes from an image plane 
remote from the observer toward an image plane 
close to the observer in synchronism with the suc- 
cessive switching of the two-dimensional images by 
the third means, and 

characterized in that when the object is mov- 
ing away from the observer, the fourth means pro- 
gressively raises the brightness levels of the object 
images displayed on the plurality of image planes 
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from an image plane close to the observer toward 
an image plane remote from the observer in syn- 
chronism with the successive switching of the two- 
dimensional images by the third means. 

106. A three-dimensional display characterized by com- 
prising: 

a three-dimensional display means having a 
plurality of two-dimensional displays located at 
different depth positions, the three-dimensional 
display means being adapted to present a 
three-dimensional image by displaying an ob- 
ject to be presented on image planes of the plu- 
rality of two-dimensional displays and by vari- 
ably setting a brightness level ratio of the plu- 
rality of two-dimensional displays according to 
a depth position of the object to be presented; 
and 

a viewing zone distributing means for distribut- 
ing a viewing zone of the three-dimensional dis- 
play means into a plurality of directions. 

107. A three-dimensional display as claimed in claim 
106, characterized in that the viewing zone distrib- 
uting means expands the viewing zone by distribut- 
ing the viewing zone. 

108. A three-dimensional display as claimed in claim 
106, characterized in that the viewing zone distrib- 
uting means increases the number of viewing zones 
by distributing the viewing zone. 

109. A three-dimensional display as claimed in claim 
106, characterized in that the viewing zone distrib- 
uting means has an optical system including either 
a plurality of total reflecting mirrors or a plurality of 
prisms, or a combination of these, and reflects or 
refracts light by the optical system to distribute the 
viewing zone. 

110. A three-dimensional display as claimed in claim 
106, characterized in that the viewing zone distrib- 
uting means has an optical system including a plu- 
rality of dichroic mirrors or dichroic prisms with dif- 
ferent reflection wavelength bands or a combination 
of these, and reflects or refracts light by the optical 
system to distribute the viewing zone. 

111. A three-dimensional display as claimed in claim 
106, characterized in that the viewing zone distrib- 
uting means has an optical system including a ho- 
lographic optical element with a plurality of reflec- 
tion angles or diffraction angles, a holographic op- 
tical element with a single reflection angle or diffrac- 
tion angle, or a combination of these, and the view- 
ing zone distributing means reflects or diffracts light 
by the optical system to distribute the viewing zone. 



112. A three-dimensional display as claimed in claim 
106, characterized in that the viewing zone distrib- 
uting means includes a prism array having an array 
of prisms with different refraction directions, and re- 

s tracts light by the prism array to distribute the view- 
ing zone. 

113. A three-dimensional display as claimed in claim 
106, characterized in that the viewing zone distrib- 

10 uting means includes a mirror array having arrays 
of mirrors with different reflection directions, and re- 
flects light by the mirror array to distribute the view- 
ing zone. 

15 114.A three-dimensional display as claimed in claim 

106, characterized in that the viewing zone distrib- 
uting means includes a diffraction grating array hav- 
ing arrays of diffraction gratings with different dif- 
fraction angles, and reflects or diffracts light by the 
diflraction graling array to dislribute the viewing 
zone. 

11 5. A three-dimensional display according to claim 1 06, 
characterized in that the viewing zone distributing 
means includes a liquid crystal deflection element 
having a liquid and an optical element disposed in 
contact with the liquid crystal, and refracts or re- 
flects light by the liquid crystal deflection element to 
distribute the viewing zone on a time division basis. 

116. A three-dimensional display as claimed in claim 

107, characterized in that the viewing zone distrib- 
uting means includes a movable optical system and 
a shutter device for performing shutter operations, 
the movable optical system being either half mir- 
rors, total reflecting mirrors or prisms, or a combi- 
nation of these, and characterized in that the view- 
ing zone distributing means distributes the viewing 
zone on a time division basis by arranging the shut- 
ter device between the three-dimensional display 
and the optical system, reflecting or refracting light 
by the optical system and synchronizing the three- 
dimensional display with the shutter device. 

117. A three-dimensional display as claimed in claim 
106, characterized in that the viewing zone distrib- 
uting means includes a movable optical system, 
which is either half mirrors, total reflection mirrors 
or prisms, or a combination of these, and the view- 
ing zone distributing means operates the optical 
system stepwise to reflect or refract light and there- 
by distribute the viewing zone on a time division ba- 
sis. 
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